-- Logs begin at Thu 2022-07-21 21:33:25 UTC, end at Thu 2022-07-21 22:58:29 UTC. -- Jul 21 22:23:40.150858 dv-cinder-850696-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 22:23:40.160018 dv-cinder-850696-1-smb devstack@keystone.service[80306]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:23:40 2022] *** Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: nodename: dv-cinder-850696-1-smb Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: machine: x86_64 Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: clock source: unix Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: pcre jit disabled Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: detected number of CPU cores: 4 Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: current working directory: / Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: your processes number limit is 47680 Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: your memory page size is 4096 bytes Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: detected max file descriptor number: 2048 Jul 21 22:23:40.162039 dv-cinder-850696-1-smb devstack@keystone.service[80306]: lock engine: pthread robust mutexes Jul 21 22:23:40.162847 dv-cinder-850696-1-smb devstack@keystone.service[80306]: thunder lock: enabled Jul 21 22:23:40.162847 dv-cinder-850696-1-smb devstack@keystone.service[80306]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 22:23:40.162847 dv-cinder-850696-1-smb devstack@keystone.service[80306]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:23:40.205393 dv-cinder-850696-1-smb devstack@keystone.service[80306]: Python main interpreter initialized at 0x5618f31f89c0 Jul 21 22:23:40.205393 dv-cinder-850696-1-smb devstack@keystone.service[80306]: python threads support enabled Jul 21 22:23:40.205393 dv-cinder-850696-1-smb devstack@keystone.service[80306]: your server socket listen backlog is limited to 100 connections Jul 21 22:23:40.205393 dv-cinder-850696-1-smb devstack@keystone.service[80306]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:23:40.205710 dv-cinder-850696-1-smb devstack@keystone.service[80306]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:23:40.205782 dv-cinder-850696-1-smb devstack@keystone.service[80306]: *** Operational MODE: preforking *** Jul 21 22:23:40.206070 dv-cinder-850696-1-smb devstack@keystone.service[80306]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:23:40.206070 dv-cinder-850696-1-smb devstack@keystone.service[80306]: spawned uWSGI master process (pid: 80306) Jul 21 22:23:40.206266 dv-cinder-850696-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 22:23:40.206763 dv-cinder-850696-1-smb devstack@keystone.service[80306]: spawned uWSGI worker 1 (pid: 80311, cores: 1) Jul 21 22:23:40.207108 dv-cinder-850696-1-smb devstack@keystone.service[80306]: spawned uWSGI worker 2 (pid: 80312, cores: 1) Jul 21 22:23:40.207277 dv-cinder-850696-1-smb devstack@keystone.service[80306]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:23:45.584510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:45.584510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: from cryptography.utils import int_from_bytes Jul 21 22:23:45.585340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:45.585340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: from cryptography.utils import int_from_bytes Jul 21 22:23:45.585751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:45.585751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: from cryptography.utils import int_from_bytes Jul 21 22:23:45.585865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:23:45.585865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: from cryptography.utils import int_from_bytes Jul 21 22:23:45.634068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:23:45.634219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:23:45.634305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:23:45.634382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:23:45.634446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] command line args: [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:23:45.634512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] command line args: [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:23:45.634569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:23:45.634630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:23:45.634794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ================================================================================ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:23:45.634876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ================================================================================ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:23:45.635017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] admin_token = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] admin_token = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] config_dir = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config_dir = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] config_source = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] config_source = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] debug = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] debug = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.635968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_config_append = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.637992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_config_append = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_dir = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_dir = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.638907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.639872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.640948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.641078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.641194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.641275 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.641511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.641715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.641872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] publish_errors = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] publish_errors = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.642983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] standard_threads = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] standard_threads = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.643875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_journal = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_json = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] use_journal = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_stderr = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] use_json = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] use_syslog = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] use_stderr = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] use_syslog = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.644930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:23:45.645049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.645931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.646974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.647911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.648988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.649978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.650969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.651898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.652937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.653715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.654929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655388 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.655938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.656919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.657920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.658974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.659921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.660914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.661903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.662891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.663960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.664959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.665882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.666900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.667937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.668934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.external = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.external = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.password = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.669976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.password = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.token = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.token = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.670973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.671919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.672924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.673918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.674908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.675961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.676949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.677930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.678885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.680900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.681906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.682939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.683920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.684922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.685972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.686868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.687934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.688912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.689901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.690899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.691943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.692945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.693927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.694936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.695944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.696936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.697919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.698912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.699924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] role.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] role.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.700998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.701981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.702979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703245 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.703911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.704911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.705917 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.706899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.707932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708150 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.708926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.709941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.710926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.711937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.712941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.713948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.714984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.715994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:23:45.716977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.716977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.717208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:23:45.717378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:23:45.747243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.747465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.747692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.748779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.749011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.749244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.755979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.757571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.784453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.784676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.785657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.785886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.929548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.929783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.977354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.977586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.978364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:45.978568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.041986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.042058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.042167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.042246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.066858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.067957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.068020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.068091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.068206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.068293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.068453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.079427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.079755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.092929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.093768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:23:46.110713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.110842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.110915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:23:46.111017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:23:46.111273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.111396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.111474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:23:46.111541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:23:46.111727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.111850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.111942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.112018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.112231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.112367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.112447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.112526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.123509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.123631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.123745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.123831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.124039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.124183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.124265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.124336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.132330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.132455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.135589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.135714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.135850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.135929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.136132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.136275 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.136570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.136695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.136831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.136909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.137938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.138019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.138175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.138299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.138421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.138526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.164977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.165101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.166561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.166687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.166844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.166929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.172137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.172261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.172391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.172472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.172671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.172795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.179947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.180068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.180201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.180297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.184754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.184880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.185017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.185964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.186114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.186196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.186364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.186488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.186623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.186716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.205231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.205357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.205485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.205565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.210020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.210145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.213649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.213820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.213903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.214043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.218906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.219053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.222504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.222630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.226258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.226403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.226541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.226620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.226825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.226951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.227152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.227236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.227404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.227528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.227652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.227757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.246437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.246561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.246806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.246930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.247113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.247195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.247370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.247493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.255229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.255447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.256910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.257084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.257175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.257240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.260236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.260379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.260519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.260639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.260755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.260956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.261091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.261237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.261318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.261498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.274596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.274743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.274881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.275944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.276159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.276284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.276409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.295934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.296282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.299240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.299553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.302537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.302825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.304162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.304453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.305793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.306040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.306163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.306298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.306376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.306582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.313790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.313994 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.315449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.315572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.318651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.318775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.318902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.319065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.319281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.319403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.319552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.319633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.328763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.328887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.329023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.329119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.329319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.329442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.337130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.337253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:23:46.337391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.337473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.337663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.337783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.337919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.337997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.338977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.339961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.340052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.340128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.340348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.340472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.340588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.340677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:23:46.378562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618f31f89c0 pid: 80311 (default app) Jul 21 22:23:46.378646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618f31f89c0 pid: 80312 (default app) Jul 21 22:23:46.381830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e29bb-4243-4190-9517-2115d20d9cf5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:46.382125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e29bb-4243-4190-9517-2115d20d9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:46.382400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e29bb-4243-4190-9517-2115d20d9cf5 None None] PATH_INFO: `/v3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:46.386728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Jul 21 22:23:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:23:54.087378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:54.088295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:54.088295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:54.093394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:23:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:54.098945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:54.099395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:54.099490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:54.168366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: INFO dbcounter [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] Registered counter for database keystone Jul 21 22:23:54.193301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG oslo_db.sqlalchemy.engines [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:54.205509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writer thread running {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:54.389505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG passlib.handlers.bcrypt [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80311) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 22:23:54.389927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG passlib.handlers.bcrypt [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80311) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 22:23:54.447610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:54.449921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:54.590884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:23:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 22:23:54.841803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:54.920037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: INFO dbcounter [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] Registered counter for database keystone Jul 21 22:23:54.941523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG oslo_db.sqlalchemy.engines [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:23:54.953127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writer thread running {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:23:55.077723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691e7a3-81b1-4aec-8cc7-bf94e109d7c7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:55.083235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:55.083898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:55.084176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:55.084455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:55.093682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:55.160380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 22:23:55.160713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e9eb0-e95f-4494-9210-17bf64c5a3e7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:55.172468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jul 21 22:23:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:23:55.178976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:55.200236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7117-088a-45fe-94cf-85c6770222dd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:55.205820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:55.206968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:55.207296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:55.207569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] PATH_INFO: `/v3/projects/68110cc172da4f7f98143d7196095a84` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:55.211913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] RBAC: Authorizing `identity:get_project(project_id=68110cc172da4f7f98143d7196095a84)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:55.262043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING keystone.common.rbac_enforcer.enforcer [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 22:23:55.262356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2c76-10be-4c1d-929a-18f46dbd7353 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:55.267089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Jul 21 22:23:55 2022] GET /identity/v3/projects/68110cc172da4f7f98143d7196095a84 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:23:57.252892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a660-f1ae-4370-a8c8-b1c4c2d3505c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:57.253453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a660-f1ae-4370-a8c8-b1c4c2d3505c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:57.253453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a660-f1ae-4370-a8c8-b1c4c2d3505c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:57.259977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:23:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:57.266325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:57.266775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:57.266866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:57.291684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:57.293304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:57.303395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:23:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 22:23:57.325820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a660-f1ae-4370-a8c8-b1c4c2d3505c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:57.341469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a660-f1ae-4370-a8c8-b1c4c2d3505c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:57.347270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb759a6-e51b-4285-8916-36df925d45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:57.347912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb759a6-e51b-4285-8916-36df925d45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:57.348201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb759a6-e51b-4285-8916-36df925d45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:57.348480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb759a6-e51b-4285-8916-36df925d45c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:57.357143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb759a6-e51b-4285-8916-36df925d45c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:57.358943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb759a6-e51b-4285-8916-36df925d45c8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:57.367870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jul 21 22:23:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:23:57.373433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:57.388784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14d09-8d87-4dd6-ba02-715d3d336e04 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:57.395328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fbef9-103e-4e8c-b3b3-e5d1cda64cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:57.396217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbef9-103e-4e8c-b3b3-e5d1cda64cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:57.396499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbef9-103e-4e8c-b3b3-e5d1cda64cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:57.396773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fbef9-103e-4e8c-b3b3-e5d1cda64cf7 admin admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:57.398409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fbef9-103e-4e8c-b3b3-e5d1cda64cf7 admin admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:57.400322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fbef9-103e-4e8c-b3b3-e5d1cda64cf7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:57.401956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Jul 21 22:23:57 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:23:59.488714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2efab6-9671-408c-8af6-0ea3c2479267 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.489272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998eb0-3b43-4dff-9874-46e26a7c3b9c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.489617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2efab6-9671-408c-8af6-0ea3c2479267 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.489713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998eb0-3b43-4dff-9874-46e26a7c3b9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.489795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2efab6-9671-408c-8af6-0ea3c2479267 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.489874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44998eb0-3b43-4dff-9874-46e26a7c3b9c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.490594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:59.490727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:23:59.495789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.495991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.496097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.496304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.496431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.496581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.513625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:59.514829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:59.536053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG passlib.handlers.bcrypt [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80312) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 22:23:59.536458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG passlib.handlers.bcrypt [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80312) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 22:23:59.581145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:59.582720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:59.601480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:23:59.624315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:59.648792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:59.695622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:23:59.717455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:59.735318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dcbaa-667a-48d1-9ac5-5201469e80a3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:59.769466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:59.770276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.770564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.770843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.782591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:23:59.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:23:59.795188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:23:59.795981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:23:59.801481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:59.817786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8678ff3-72ec-42f1-80e5-4dfa66117e55 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:59.820440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:59.856859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:59.857759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.858044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.858292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.883374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:59.901730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a00445-9d56-4cee-993e-7669aecf948b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:59.926574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:59.928148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:59.942121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:59.943164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:59.943595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:59.944013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:59.945234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:23:59.945701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:59.947962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:59.962745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 9/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:23:59.968697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:00.045101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 7/16] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:00.051013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:00.053692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:00.066520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb353f1-6ec6-4575-b951-749ee528df79 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:00.099376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:00.100265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.100552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.100827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.102069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:00.103575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:00.105212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 10/17] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:23:59 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:00.110668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:00.124681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:00.148934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa3b0a-9f90-40ef-9706-7562620c513e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:00.184485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:00.185230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.185513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.185792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.204082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:00.205647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:00.209147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16402ffd-57e0-4413-841c-9a12b3eaa675 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:24:00.225924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:00.226748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:00.227678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:24:00.227678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:24:00.227678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:24:00.227678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:00.227678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 8/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:24:00.233062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:00.245368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:00.246213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.246535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.246842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.248058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:00.249499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:00.251153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 11/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:00.256793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:00.295238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:00.343701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf963a-eadb-4b90-9a9f-97922c023411 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:00.346604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:00.365736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15870af4-7391-4c53-8bf7-77e25fa2dbde None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:00.385674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:00.386366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.386703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.386980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.387752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:00.388065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:00.389479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8663dc-edc0-4773-9a8c-92e7e56d5749 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:00.398334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:00.399012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.399294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.399562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.400423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.domain.id=default, user.id=bd30b180b5054c1bbf1a42f4fe12ac4f) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:00.400720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:00.402142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846cc45-0519-4bac-9cec-661d50cd6d2e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:00.408147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 9/20] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:00.409186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 12/21] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jul 21 22:24:00 2022] GET /identity/v3/role_assignments?user.id=bd30b180b5054c1bbf1a42f4fe12ac4f&scope.domain.id=default&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:02.785749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4925603-f7a6-4de1-a3db-f4b5de3da5e7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:02.786266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4925603-f7a6-4de1-a3db-f4b5de3da5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:02.786442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4925603-f7a6-4de1-a3db-f4b5de3da5e7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:02.787715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 10/22] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:02.792979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:02.793396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:02.793557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:02.811299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed1b06-6063-4756-992d-ef63e65a584a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:02.811594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed1b06-6063-4756-992d-ef63e65a584a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:02.811873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed1b06-6063-4756-992d-ef63e65a584a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:02.813239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 11/23] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:02.818375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:02.818657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:02.818934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:02.819218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:02.820423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:02.852068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:02.853287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:02.938745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:02.985782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:02.999023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:03.032711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.095451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.120298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.142696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b64e2d-2211-42d8-ad26-a79c37e46682 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.216518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0afd1-13f3-4eb5-ac49-420d62292709 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.218035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.219088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.219465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.219962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.251904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.253302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8118ca9-a299-4f36-9d35-993ebd362def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.253748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:03.254595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8118ca9-a299-4f36-9d35-993ebd362def None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.255113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8118ca9-a299-4f36-9d35-993ebd362def None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.255587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8118ca9-a299-4f36-9d35-993ebd362def None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.270482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8118ca9-a299-4f36-9d35-993ebd362def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a8118ca9-a299-4f36-9d35-993ebd362def None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:03.280285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:03.281134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:03.281863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:03.284232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 13/26] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:24:03.285677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308e89-7eca-40e8-8f73-ced7a2c83675 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.286148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308e89-7eca-40e8-8f73-ced7a2c83675 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.286627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308e89-7eca-40e8-8f73-ced7a2c83675 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.288100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:24:03.293584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:03.294621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:03.295453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:24:03.295453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:24:03.295453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:24:03.295453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:03.295453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:03.299951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308e89-7eca-40e8-8f73-ced7a2c83675 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.301004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.453593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308e89-7eca-40e8-8f73-ced7a2c83675 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.460263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd8b8c-fd4c-421e-9671-e07b0f728211 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.463855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.487572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.497442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.498360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.498808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.499303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.500196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:03.500665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.500983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.501721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.502007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.502285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.502974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a523169-e85e-4364-94cb-9894070dfd66 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:03.503090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:03.503378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.504765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d38f7-4845-4620-b0f9-332650fdd035 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:03.522147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:03.523595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.523890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.524168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.524577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:03.526089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600978-0868-4af3-9934-e916ef380074 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.526562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600978-0868-4af3-9934-e916ef380074 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.527063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600978-0868-4af3-9934-e916ef380074 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.528919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:03.530127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600978-0868-4af3-9934-e916ef380074 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.553036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:03.554239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:03.647092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:03.647092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.651683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600978-0868-4af3-9934-e916ef380074 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.705422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6e55c-9ceb-4513-ba57-af2775ee5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.706905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6e55c-9ceb-4513-ba57-af2775ee5e63 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.707420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6e55c-9ceb-4513-ba57-af2775ee5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.707967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6e55c-9ceb-4513-ba57-af2775ee5e63 None admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.709524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6e55c-9ceb-4513-ba57-af2775ee5e63 None admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.711322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6e55c-9ceb-4513-ba57-af2775ee5e63 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:03.713271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:03 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:03.715055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.715544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.716016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.733868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:03.735453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:03.759662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.765160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d468679-ca60-4f4d-9404-755061c6931e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.792299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.810944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.812148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:03.812542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.812802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.813078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.814018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.814117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.819653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:03.940404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c8de1-b6e8-439d-bbbd-7077a3bfec30 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.975883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.976837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.977178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 17/35] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:24:03 2022] POST /identity/v3/projects => generated 301 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:03.977296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.977526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.978487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.978688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.980147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.093604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf031a-c85e-451f-aa23-ceee71e85c38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:04.128707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 19/36] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 22:24:03 2022] POST /identity/v3/roles => generated 219 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:04.130136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:04.139748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d96fad-03e1-4db4-aa11-d7b32361e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:04.140705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96fad-03e1-4db4-aa11-d7b32361e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.141078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96fad-03e1-4db4-aa11-d7b32361e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.141427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d96fad-03e1-4db4-aa11-d7b32361e3f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.143640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d96fad-03e1-4db4-aa11-d7b32361e3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:04.145337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d96fad-03e1-4db4-aa11-d7b32361e3f6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.151719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 18/37] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:04.153530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac20de-910f-4fe7-842a-1c4f2d3cf10c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.153936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac20de-910f-4fe7-842a-1c4f2d3cf10c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.154674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac20de-910f-4fe7-842a-1c4f2d3cf10c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.156266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:04.160141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac20de-910f-4fe7-842a-1c4f2d3cf10c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:04.194632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:04.199587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:04.279520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc50f9-6c75-4e9b-b970-4c375f24da7b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:04.308422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac20de-910f-4fe7-842a-1c4f2d3cf10c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:04.322099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea383-3fc7-441e-b30a-9be92e209560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:04.322800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea383-3fc7-441e-b30a-9be92e209560 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.323127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea383-3fc7-441e-b30a-9be92e209560 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.323399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea383-3fc7-441e-b30a-9be92e209560 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.324225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea383-3fc7-441e-b30a-9be92e209560 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:04.325910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea383-3fc7-441e-b30a-9be92e209560 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.342457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 22:24:04 2022] POST /identity/v3/roles => generated 225 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:04.344103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.344404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.344685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.346483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef741e15-c557-4bf7-86ce-ba864ab82131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:04.347473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741e15-c557-4bf7-86ce-ba864ab82131 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.347759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741e15-c557-4bf7-86ce-ba864ab82131 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.348038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741e15-c557-4bf7-86ce-ba864ab82131 None admin] PATH_INFO: `/v3/domains/default/users/bd30b180b5054c1bbf1a42f4fe12ac4f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.350519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef741e15-c557-4bf7-86ce-ba864ab82131 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bd30b180b5054c1bbf1a42f4fe12ac4f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:04.352120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef741e15-c557-4bf7-86ce-ba864ab82131 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.365689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:04.367567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:04.378044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Jul 21 22:24:04 2022] PUT /identity/v3/domains/default/users/bd30b180b5054c1bbf1a42f4fe12ac4f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:04.379934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30fdb-9a2b-46d7-9850-2338778f6762 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.380925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30fdb-9a2b-46d7-9850-2338778f6762 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.381215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30fdb-9a2b-46d7-9850-2338778f6762 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.384891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 21/41] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:04.390265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.390580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.390822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.419095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:04.422101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:04.519967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:04.545334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:04.557489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:04.607831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:04.632024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:04.667283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:04.668936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b072-cde5-4ccc-b837-a417b72d0fbb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:04.706870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:04.707728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.708005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.708347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.709477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:04.710962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.712652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 23/44] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:04.718179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:04.742362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c189148-ba6f-444f-b532-16b7e7b7d739 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:04.784110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ce7e4-9769-416d-9a97-ecb983c22c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:04.785143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce7e4-9769-416d-9a97-ecb983c22c93 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.785493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce7e4-9769-416d-9a97-ecb983c22c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.785776 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ce7e4-9769-416d-9a97-ecb983c22c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.786536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ce7e4-9769-416d-9a97-ecb983c22c93 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:04.788011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ce7e4-9769-416d-9a97-ecb983c22c93 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.802096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 22:24:04 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:24:04.802409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:04.835615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1047a3-b0c4-4e24-9977-f9f5364250a2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:04.875414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221991-46ce-4af8-b279-8944cd117b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:04.876119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221991-46ce-4af8-b279-8944cd117b45 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:04.876386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221991-46ce-4af8-b279-8944cd117b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:04.876663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221991-46ce-4af8-b279-8944cd117b45 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:04.877398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa221991-46ce-4af8-b279-8944cd117b45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:04.878879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa221991-46ce-4af8-b279-8944cd117b45 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:04.910433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:24:04 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:06.462132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fe365-1ff4-45ba-a246-fcba6fa085bb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:06.462692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fe365-1ff4-45ba-a246-fcba6fa085bb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:06.462692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fe365-1ff4-45ba-a246-fcba6fa085bb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:06.464275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:06.469542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:06.469960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:06.470098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:06.597648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:06.598839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:06.666501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:06.689431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fe365-1ff4-45ba-a246-fcba6fa085bb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:06.798163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:06.807388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fe365-1ff4-45ba-a246-fcba6fa085bb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:06.840397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd76096-042d-418c-8629-52eacd961e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:06.841203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76096-042d-418c-8629-52eacd961e15 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:06.841491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76096-042d-418c-8629-52eacd961e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:06.841769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76096-042d-418c-8629-52eacd961e15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:06.852289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd76096-042d-418c-8629-52eacd961e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8fd76096-042d-418c-8629-52eacd961e15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:06.860196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:06.861006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:06.861749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:06.867586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:06.926637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:06.946068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee9fd-316a-402a-961e-c701700c5807 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:06.946352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee9fd-316a-402a-961e-c701700c5807 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:06.946628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee9fd-316a-402a-961e-c701700c5807 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:06.948024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 25/50] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:06.953019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:06.953302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:06.953572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:06.969034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a011-f617-4db1-8382-ab7cd1fb4281 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:06.970683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:06.971948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:07.001840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:07.002506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:07.002784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:07.003119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:07.003876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:07.004181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:07.005561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:07.013718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:07.019454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:07.045128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 26/52] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:07.068322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:07.135525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44132238-8e7d-4d75-a087-f90a224bbe95 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:07.156279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:07.161900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:07.171914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:07.172814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:07.173100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:07.173375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:07.174599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:07.176104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:07.177848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:07 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:07.178933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65c90-22b0-4472-974c-3419759c3362 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:07.183359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:07.213554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:07.214370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:07.214652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:07.214960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:07.216187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:07.217688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:07.219385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:07.224913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:07.281427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc7362-db40-4bde-83f4-72a06f701a38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:07.315021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:07.315836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:07.316123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:07.316410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:07.317589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:07.318867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908c085-9b61-4046-9bca-eda2f76f2ddc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:07.319078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:07.320717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:07.326465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:07.354192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bbbdc-0074-4a9d-b0d5-4d842d634502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:07.354872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbbdc-0074-4a9d-b0d5-4d842d634502 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:07.355184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbbdc-0074-4a9d-b0d5-4d842d634502 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:07.355465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbbdc-0074-4a9d-b0d5-4d842d634502 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:07.356212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bbbdc-0074-4a9d-b0d5-4d842d634502 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:07.357681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bbbdc-0074-4a9d-b0d5-4d842d634502 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:07.383445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:07.389556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 28/56] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jul 21 22:24:07 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:24:07.435384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc85491-1e17-4224-849a-553901dc5f27 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:07.472390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:07.473056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:07.473349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:07.473628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:07.474489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.domain.id=default, user.id=bd30b180b5054c1bbf1a42f4fe12ac4f) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:07.474805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:07.476386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c93808-ea5d-40a2-a139-9b39c01a2ee6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:07.485633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jul 21 22:24:07 2022] GET /identity/v3/role_assignments?user.id=bd30b180b5054c1bbf1a42f4fe12ac4f&scope.domain.id=default&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:09.407068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69a13-2278-408c-8629-71ee72ea797e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:09.407533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69a13-2278-408c-8629-71ee72ea797e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:09.407649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69a13-2278-408c-8629-71ee72ea797e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:09.409749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:09.417623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:09.418047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:09.418241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:09.435896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:09.437093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:09.506171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:09.530952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69a13-2278-408c-8629-71ee72ea797e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:09.535343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:09.639680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69a13-2278-408c-8629-71ee72ea797e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:09.674587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a826e8d-f683-4444-93c0-3d1df4c40d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:09.675407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a826e8d-f683-4444-93c0-3d1df4c40d9a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:09.675695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a826e8d-f683-4444-93c0-3d1df4c40d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:09.675964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a826e8d-f683-4444-93c0-3d1df4c40d9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:09.677256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a826e8d-f683-4444-93c0-3d1df4c40d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:09.678711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a826e8d-f683-4444-93c0-3d1df4c40d9a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:09.680373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:09.686831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:09.747264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:09.801473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652c453-e339-47f8-a99f-0c57c78ea686 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:09.836807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f0ad3-37a5-446e-969e-e1b2a69774cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:09.837477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f0ad3-37a5-446e-969e-e1b2a69774cd None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:09.837761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f0ad3-37a5-446e-969e-e1b2a69774cd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:09.838032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f0ad3-37a5-446e-969e-e1b2a69774cd None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:09.838751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f0ad3-37a5-446e-969e-e1b2a69774cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:09.840331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f0ad3-37a5-446e-969e-e1b2a69774cd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:09.866683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:09 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:13.040863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b237-dbcc-4e02-9413-ca131e7787c3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.041414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b237-dbcc-4e02-9413-ca131e7787c3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.041414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b237-dbcc-4e02-9413-ca131e7787c3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.043156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:13.056536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0420-8a00-485a-9fb3-bea9adc9cde8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.057007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0420-8a00-485a-9fb3-bea9adc9cde8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.057104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0420-8a00-485a-9fb3-bea9adc9cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.075743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e1da0420-8a00-485a-9fb3-bea9adc9cde8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:13.077009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1da0420-8a00-485a-9fb3-bea9adc9cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:13.094619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baffd1-9650-48c6-af6f-99dd2d0f7ae2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.095262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baffd1-9650-48c6-af6f-99dd2d0f7ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.095869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7baffd1-9650-48c6-af6f-99dd2d0f7ae2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.097705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:13.102640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d218e6-5c4d-4d82-836e-8937a02b97cb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.103194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d218e6-5c4d-4d82-836e-8937a02b97cb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.103788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d218e6-5c4d-4d82-836e-8937a02b97cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.132576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-48d218e6-5c4d-4d82-836e-8937a02b97cb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:13.135914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-48d218e6-5c4d-4d82-836e-8937a02b97cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:13.200856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:13.222413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b00b-db97-4771-8dba-a5147ec2a143 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.222709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b00b-db97-4771-8dba-a5147ec2a143 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.223004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b00b-db97-4771-8dba-a5147ec2a143 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.224777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 33/65] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:13.225688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b00b-db97-4771-8dba-a5147ec2a143 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.249262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:13.251052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.251472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.251909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.270847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:13.272030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:13.287915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:13.289140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:13.344743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b00b-db97-4771-8dba-a5147ec2a143 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.361199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:13.361958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.384168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.385181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.385562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.385939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.404245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:13.412772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:13.413637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:13.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:13.414972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:13.415583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.479912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5a0f-3eb4-46e3-ac54-4e7b94ff5ef9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.510736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:13.513670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:13.519349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.520174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.520461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.520735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.520886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813e002-87bc-4319-99b4-789c0527349f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.534885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:13.544546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:13.545924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:13.547552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.562196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.563265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.563616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.563961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.575180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:13.583675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:13.585633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:13.587408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.656378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed2d3-2693-4f77-853e-ea5702032d4c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.691715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.692400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.692688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.692980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.693725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:13.694040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:13.695501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8c23-f984-45de-81c2-21dbbd91bf83 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:13.697946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572cab2-9a6b-4c15-add4-d0407f85517a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.704293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:13.706900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14b015-c06d-43ad-a031-8ed4a1b4417e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.707219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14b015-c06d-43ad-a031-8ed4a1b4417e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.707502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14b015-c06d-43ad-a031-8ed4a1b4417e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.709023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 37/72] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:13.711246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14b015-c06d-43ad-a031-8ed4a1b4417e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.739299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.739986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.740282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.740560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.741316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:13.741626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:13.743106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:13.752218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:13.752218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.769470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:13.770953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:13.818034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14b015-c06d-43ad-a031-8ed4a1b4417e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.850663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.851370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.851657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.851937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.852698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:13.853007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:13.853644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d9130-920d-4e47-aa1a-23ea96f6e30d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:13.854411 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9abe6-becd-447c-bd8f-63710e11ec85 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:13.862368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:13.863634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.863933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.864205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.881443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:13.882640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:13.888107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bff2e-945d-4f01-9532-70194ebc0460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:13.888999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bff2e-945d-4f01-9532-70194ebc0460 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.889280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bff2e-945d-4f01-9532-70194ebc0460 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.889579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bff2e-945d-4f01-9532-70194ebc0460 None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.905060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bff2e-945d-4f01-9532-70194ebc0460 None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:13.906572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bff2e-945d-4f01-9532-70194ebc0460 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:13.908393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:13.909432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeffea6-2e7f-4d12-827e-b8037fc868dc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:13.909718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeffea6-2e7f-4d12-827e-b8037fc868dc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:13.909991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeffea6-2e7f-4d12-827e-b8037fc868dc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:13.911239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 38/76] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:13.911927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeffea6-2e7f-4d12-827e-b8037fc868dc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:13.956268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:13.957133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.002894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.007498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.027649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeffea6-2e7f-4d12-827e-b8037fc868dc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.059172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab693-ef1c-40b0-8df2-26f965575574 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.061611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.062507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.062791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.063097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.064290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.065766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.067460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:14.068228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.097779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959da5-b16a-4263-9782-7c7bf1d9115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.098645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959da5-b16a-4263-9782-7c7bf1d9115b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.098913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959da5-b16a-4263-9782-7c7bf1d9115b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.099234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959da5-b16a-4263-9782-7c7bf1d9115b None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.100427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959da5-b16a-4263-9782-7c7bf1d9115b None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.101875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959da5-b16a-4263-9782-7c7bf1d9115b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.103561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:13 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:14.104673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.104954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.105227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.121566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:14.122773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:14.167376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef348-9e5b-4185-87bd-1a9337f71b71 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.187435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 41/80] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:14.188250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.199507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.200174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.200458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.200733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.215994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.249322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.268606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.270112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.304806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7ee6e-1997-48ea-b67a-7c4ceab54047 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.339897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.340873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.341136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.341417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.342577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.344065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.345885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:14.346449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.385058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:14.386118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.429602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.448787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182e34b-2646-4adc-a91f-e52f25df7b66 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.462402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.481398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90c1f-c585-43bf-b2ee-69ac224b801d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.488148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.488813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.489097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.489373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.516026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.516684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.516971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.517251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.558289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.559859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.584517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.586007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.629725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.664963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:14.664963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.676883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.685239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 41/84] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:14.686008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.761369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bfdde-b750-41fe-8dfa-bf97b8fbfa99 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.781523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2701f1-eb83-4ac2-863a-8e0b49baa2d1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.796189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.797003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.797289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.797572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.808104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:14.814582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.823056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.823056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.823056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:14.823310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:14.824119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:14.824985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:14.825578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.825647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 44/85] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:14.825714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.825786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.836562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.842395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 42/86] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:14 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:14.843279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.895377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.931885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495799-0fd0-4e34-9678-c221811d644c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.964716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43728cf-aa2f-450e-9f70-64c4ba284276 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.972419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.973329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.973615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.973889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.975265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.976798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.978628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 45/87] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:14.979474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.009296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.010288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.010650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.010935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.012564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.013704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.019065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 43/88] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.019065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.102747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:15.105564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166c001-49b0-46a6-9dc1-66ceb5c9a389 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.151852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d49c32-ff5c-47be-aa02-4a7b540a95db None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.155883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.156780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.157063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.157338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.158570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.160474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.161985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 46/89] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.163583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.177943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:15.198393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.199557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.199907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.200247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.201068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:15.201438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.202936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.212445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 44/90] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.213171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.283212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf870f-19a8-4c96-8252-5cb640ff1aee None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.319417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.320561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.321169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.321737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.322815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=f9dbca93f4b04d93985c947947b1a2e2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:15.323352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.325271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.332027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 47/91] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:15 2022] GET /identity/v3/role_assignments?user.id=f9dbca93f4b04d93985c947947b1a2e2&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.333144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.338398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0d41-9a56-4814-b89d-836ac32eba8f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.396694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:15.408607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.410567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.411278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.413542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.414916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=bd30b180b5054c1bbf1a42f4fe12ac4f) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:15.416447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.419213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.434453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 45/92] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:15 2022] GET /identity/v3/role_assignments?user.id=bd30b180b5054c1bbf1a42f4fe12ac4f&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.434453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.483427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:15.527660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ee04d-6f90-473d-8ca8-495130935a81 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.597696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.598310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.598596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.598878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.599777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] RBAC: Adding query filter params (role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=f9dbca93f4b04d93985c947947b1a2e2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:15.600096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.601766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.614270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910585a-33d9-4880-83fa-dbd0d47cdf83 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.616344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:15 2022] GET /identity/v3/role_assignments?user.id=f9dbca93f4b04d93985c947947b1a2e2&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.670670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.671766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.672191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.672636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.680187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.681744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:15.683767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 46/94] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:15 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:15.691287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:15.829928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbcff-2e07-460b-8513-bafbb6fd40c1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:15.876685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:15.877274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:15.877556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:15.877829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:15.884061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:15.982404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:15.985021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:16.125777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 49/95] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:16.126862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:16.202098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:16.226759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c93ea9-5529-4086-b903-9d74896fd04a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:16.260651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bf716-3254-44b1-996d-e06b40a042ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:16.261533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf716-3254-44b1-996d-e06b40a042ad None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:16.261814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf716-3254-44b1-996d-e06b40a042ad None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:16.262147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bf716-3254-44b1-996d-e06b40a042ad None admin] PATH_INFO: `/v3/projects/61c190765f3e434c996ef403f411c2dc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:16.263402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bf716-3254-44b1-996d-e06b40a042ad None admin] RBAC: Authorizing `identity:get_project(project_id=61c190765f3e434c996ef403f411c2dc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:16.264860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bf716-3254-44b1-996d-e06b40a042ad None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:16.266592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:16 2022] GET /identity/v3/projects/61c190765f3e434c996ef403f411c2dc => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:16.272517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:16.320470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:16.397810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f296-65b2-476e-8b16-62906d0393db None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:16.431488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:16.432155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:16.432438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:16.432707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:16.433552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=61c190765f3e434c996ef403f411c2dc, user.id=f9dbca93f4b04d93985c947947b1a2e2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:16.433861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:16.435404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45e7b-25fa-4345-8b19-08c9ab91a5eb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:16.441129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:16 2022] GET /identity/v3/role_assignments?user.id=f9dbca93f4b04d93985c947947b1a2e2&scope.project.id=61c190765f3e434c996ef403f411c2dc&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:17.606654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067173a-b135-413d-8193-c50a114026a4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:17.607521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067173a-b135-413d-8193-c50a114026a4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:17.607963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067173a-b135-413d-8193-c50a114026a4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:17.609718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 48/98] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:17.615372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:17.616166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:17.616644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:17.634463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:17.636008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:17.707970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 51/99] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:17.743342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067173a-b135-413d-8193-c50a114026a4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:17.859765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067173a-b135-413d-8193-c50a114026a4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:17.899523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:17.902934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc267a6-d022-4aa4-bc60-5700cec3f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:17.904208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc267a6-d022-4aa4-bc60-5700cec3f76d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:17.905108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc267a6-d022-4aa4-bc60-5700cec3f76d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:17.905727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc267a6-d022-4aa4-bc60-5700cec3f76d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:17.920069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc267a6-d022-4aa4-bc60-5700cec3f76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2cc267a6-d022-4aa4-bc60-5700cec3f76d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:17.927985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:17.928810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:17.929937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 49/100] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:17.935235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:17.969860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:18.070638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ecb20-5c92-4a7d-a6cc-0ba4b1ef6452 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.070964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ecb20-5c92-4a7d-a6cc-0ba4b1ef6452 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.071217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ecb20-5c92-4a7d-a6cc-0ba4b1ef6452 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.071925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04c3b4-6428-4432-8fcc-7e365354c524 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:18.072823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 50/101] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:18.077788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.078072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.078348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.116384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:18.117600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:18.120399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:18.121399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.121968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.122436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.123430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:18.123950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:18.125538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:18.141068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:18.146669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:18.227635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:18.262848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:18.399243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704bbf-6a58-4dc4-9cc2-50c258e0614e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:18.432265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:18.435403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:18.438951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a347d-6325-4616-9647-1a1bb3f7b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:18.439806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a347d-6325-4616-9647-1a1bb3f7b1fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.440085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a347d-6325-4616-9647-1a1bb3f7b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.440361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a347d-6325-4616-9647-1a1bb3f7b1fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.442845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a347d-6325-4616-9647-1a1bb3f7b1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:18.444423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a347d-6325-4616-9647-1a1bb3f7b1fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:18.446912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 52/104] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:18.453055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f959ec-5d1b-49ab-9044-353f8cb42375 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.453501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f959ec-5d1b-49ab-9044-353f8cb42375 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.453936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f959ec-5d1b-49ab-9044-353f8cb42375 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.455425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 53/105] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:18.457141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f959ec-5d1b-49ab-9044-353f8cb42375 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:18.461797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada692a6-6561-40b1-b650-9cd52208a276 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:18.531716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3d04-2b00-4b19-8a86-6027b54ec26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:18.532903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3d04-2b00-4b19-8a86-6027b54ec26e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.533317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3d04-2b00-4b19-8a86-6027b54ec26e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.533766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3d04-2b00-4b19-8a86-6027b54ec26e None admin] PATH_INFO: `/v3/users/02242c89dad04a00be863c4aa3db1322` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.560027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d3d04-2b00-4b19-8a86-6027b54ec26e None admin] RBAC: Authorizing `identity:get_user(user_id=02242c89dad04a00be863c4aa3db1322)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:18.562351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d3d04-2b00-4b19-8a86-6027b54ec26e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:18.564539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 53/106] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:18 2022] GET /identity/v3/users/02242c89dad04a00be863c4aa3db1322 => generated 289 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:18.567004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.568770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.569350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.602631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:18.606363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:18.644631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f959ec-5d1b-49ab-9044-353f8cb42375 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:18.702906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab790-8999-4166-949c-c9bbae99786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:18.703564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab790-8999-4166-949c-c9bbae99786c None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.703844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab790-8999-4166-949c-c9bbae99786c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.704118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab790-8999-4166-949c-c9bbae99786c None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.704833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ab790-8999-4166-949c-c9bbae99786c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:18.706304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ab790-8999-4166-949c-c9bbae99786c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:18.727839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:18.735010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:18.735634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 54/108] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:24:18 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:18.745050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cf4b3-f697-4c25-85b4-57df8e4b015f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.745485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cf4b3-f697-4c25-85b4-57df8e4b015f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.745765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cf4b3-f697-4c25-85b4-57df8e4b015f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.748824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 55/109] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:18.762108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.762446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.762727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:18.788564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:18.790571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:18.839724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:18.865787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:18.883360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 56/110] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:18.884453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:18.892094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e3d7e-fe9c-45b7-955e-b856293ad394 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:18.939465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49db76-53d8-42b9-ba28-c37d6aba1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:18.939834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49db76-53d8-42b9-ba28-c37d6aba1b27 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:18.940121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49db76-53d8-42b9-ba28-c37d6aba1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:18.940397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49db76-53d8-42b9-ba28-c37d6aba1b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.003962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc660ce-9f91-4ca9-8d46-317aab36fe14 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.031203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49db76-53d8-42b9-ba28-c37d6aba1b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.032916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49db76-53d8-42b9-ba28-c37d6aba1b27 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.047169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2aeda-bd55-4f44-8a35-064cd8a066bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.048025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2aeda-bd55-4f44-8a35-064cd8a066bc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.048413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2aeda-bd55-4f44-8a35-064cd8a066bc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.048683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2aeda-bd55-4f44-8a35-064cd8a066bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.059841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2aeda-bd55-4f44-8a35-064cd8a066bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-72a2aeda-bd55-4f44-8a35-064cd8a066bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:19.068279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:19.069111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:19.069838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 57/111] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:19.071179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ba37-3e3b-452a-82de-50f7aa3cb1bf None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.071179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ba37-3e3b-452a-82de-50f7aa3cb1bf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.071434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ba37-3e3b-452a-82de-50f7aa3cb1bf None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.077155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 58/112] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:19.077155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ba37-3e3b-452a-82de-50f7aa3cb1bf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.105234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.129956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.152667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:19.154142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.159474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.159834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.177471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:19.178775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:19.183944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ba37-3e3b-452a-82de-50f7aa3cb1bf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.221112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.222027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.222372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.222706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.234059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:19.241896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:19.242713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:19.243892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 59/114] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:19.244845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.251659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:19.259958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.357733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.362567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3009f-b5eb-47ea-9021-21be8e44d68e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.369155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a4796-3cf9-4df6-9f6c-68ac3b51ba1a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.379107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.409413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.409739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8715b-47f7-4ec3-b938-88a9d6668bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.410103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.410449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.410549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8715b-47f7-4ec3-b938-88a9d6668bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.410700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.410849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8715b-47f7-4ec3-b938-88a9d6668bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.411115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8715b-47f7-4ec3-b938-88a9d6668bc9 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.411469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:19.411782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.412407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8715b-47f7-4ec3-b938-88a9d6668bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.413194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.413877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8715b-47f7-4ec3-b938-88a9d6668bc9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.415631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 57/116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:19.421625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697ae0-edca-4092-803a-ba7b9fb29f2e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.426702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697ae0-edca-4092-803a-ba7b9fb29f2e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.426819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 60/117] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:19.426907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697ae0-edca-4092-803a-ba7b9fb29f2e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.427118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.427207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 58/118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:19.427207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697ae0-edca-4092-803a-ba7b9fb29f2e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.530793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e8bb4-579d-4cbd-9be9-91580df07526 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.534011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72697ae0-edca-4092-803a-ba7b9fb29f2e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.566323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.567034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.567326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.567605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.568361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:19.568671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.569204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.570043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.570131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.570329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.570607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.582893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 61/119] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:19.582893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.587662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:19.595244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:19.599558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:19.600560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:19.601340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 59/120] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:19.601944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.645424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.688180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92085038-f2ce-446d-8595-9dbe91588e5a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.710311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4309-dbf4-4609-86ec-2e3f2a4ac100 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.722772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.723489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.723779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.724064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.724905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] RBAC: Adding query filter params (role.id=8c92d030e061456db1d51b8f27c13df7, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=02242c89dad04a00be863c4aa3db1322) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:19.725222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.726675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd483b2-1b93-438b-b4cb-c803543a9ad7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.732227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/role_assignments?user.id=02242c89dad04a00be863c4aa3db1322&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=8c92d030e061456db1d51b8f27c13df7 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:19.733400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.733690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.733972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.754777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:19.756089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:19.758800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.760393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.760819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.761224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.762743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.764424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.766822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:19.767924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.840656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 63/123] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:19.841840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.860007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.921823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642ec09-ab42-417e-ab6d-a410ca5342d5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:19.929651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.959525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:19.960422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:19.960705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:19.961050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:19.962292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:19.963832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:19.965522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:19.971141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:19.975676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808118-81f1-45d1-8b7a-be3477f3d705 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.025711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.026519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.026805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.027099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.027893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:20.028200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.030021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.039012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.039841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.093964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3814e7-4dec-4101-88e1-4290711227c1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.125815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:20.132682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.133570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.133853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.134192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.135389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.136902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.138739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:19 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.139626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.161848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee44f-9de5-4572-9063-440d07100d90 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.186903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:20.197541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.198560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.199469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.199918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.213872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:20.223644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:20.224671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:20.225593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:20.228215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:20.229204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.257551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9f5c-8a93-46dd-98ed-67bdc9eb5127 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.303254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.304662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.305629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.306050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.307671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.310494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.312424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.313312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.350751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcc8a-eab4-453d-a3f1-3508e6434a9d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.390481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:20.398636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.400181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.400950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.401668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.403327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.405976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.408288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.409335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.424431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04a85-8520-43a6-bf6b-f7ed0f575ee2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.439097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:20.466068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.466981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.467609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.467609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/bd30b180b5054c1bbf1a42f4fe12ac4f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.469645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] RBAC: Authorizing `identity:create_grant(project_id=25ef1dfe56b347a2b0d8603d7447b428, user_id=bd30b180b5054c1bbf1a42f4fe12ac4f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.471364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.489694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 64/130] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:20 2022] PUT /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/bd30b180b5054c1bbf1a42f4fe12ac4f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:20.490616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.528707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8693-b380-402c-9a6e-fa076474e2d3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.566865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.568007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.568501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.568989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.569943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:20.570442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.572056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.581237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.582462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.639342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85975314-3834-4a18-b984-363f5fc94faf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.682971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.684577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.684868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.685194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/f9dbca93f4b04d93985c947947b1a2e2/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.688136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] RBAC: Authorizing `identity:create_grant(project_id=25ef1dfe56b347a2b0d8603d7447b428, user_id=f9dbca93f4b04d93985c947947b1a2e2, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.691304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.708943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 65/132] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:20 2022] PUT /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/f9dbca93f4b04d93985c947947b1a2e2/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:20.714388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.756308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:20.787201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:20.872585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1a29-e65c-4a82-9e98-2cdf214ece04 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.875909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7047c63-8e4b-44b8-874b-7e414858962b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:20.911229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.912248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.912532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.912807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.914032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.915576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.922010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 66/133] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.923525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:20.954099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:20.955343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:20.955814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:20.956267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:20.959811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:20.961536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:20.964572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 68/134] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:20.969251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:21.038234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:21.042938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daadea-3b3d-4370-aa4a-dac500a2b53e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:21.086251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debce74-8a81-432d-b235-3a19c18e5a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:21.087452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debce74-8a81-432d-b235-3a19c18e5a65 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.087746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debce74-8a81-432d-b235-3a19c18e5a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.088027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debce74-8a81-432d-b235-3a19c18e5a65 None admin] PATH_INFO: `/v3/projects/61c190765f3e434c996ef403f411c2dc` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.089513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debce74-8a81-432d-b235-3a19c18e5a65 None admin] RBAC: Authorizing `identity:get_project(project_id=61c190765f3e434c996ef403f411c2dc)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:21.091213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debce74-8a81-432d-b235-3a19c18e5a65 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:21.093466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 67/135] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:20 2022] GET /identity/v3/projects/61c190765f3e434c996ef403f411c2dc => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:21.094753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881e89-031c-4d65-b635-6a0afb37fec2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.095071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881e89-031c-4d65-b635-6a0afb37fec2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.095412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4881e89-031c-4d65-b635-6a0afb37fec2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.096809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 68/136] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:21.102661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.103031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.103321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.121782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:21.123147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:21.133841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567574-a04b-4206-91db-909451f2cab5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:21.161553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:21.169724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:21.170637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.170919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.171242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/f9dbca93f4b04d93985c947947b1a2e2/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.174151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=25ef1dfe56b347a2b0d8603d7447b428, user_id=f9dbca93f4b04d93985c947947b1a2e2, role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:21.175662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:21.192523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 69/137] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:20 2022] PUT /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/f9dbca93f4b04d93985c947947b1a2e2/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:24:21.193663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:21.216580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 69/138] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:21.312271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:21.393963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7fdb9-8d96-4b09-8953-2ed2733a18d2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:21.471124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:21.471961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.472247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.472540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] PATH_INFO: `/v3/projects/61c190765f3e434c996ef403f411c2dc/users/f9dbca93f4b04d93985c947947b1a2e2/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.478190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=61c190765f3e434c996ef403f411c2dc, user_id=f9dbca93f4b04d93985c947947b1a2e2, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:21.479755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:21.490320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:21.496753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df1d2-51fd-4887-a668-54877b83c850 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:21.506367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:21 2022] PUT /identity/v3/projects/61c190765f3e434c996ef403f411c2dc/users/f9dbca93f4b04d93985c947947b1a2e2/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:21.543050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633903b-20c1-437d-8471-44d82c249d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:21.543956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633903b-20c1-437d-8471-44d82c249d47 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.544248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633903b-20c1-437d-8471-44d82c249d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.544527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633903b-20c1-437d-8471-44d82c249d47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.545828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633903b-20c1-437d-8471-44d82c249d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:21.547380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633903b-20c1-437d-8471-44d82c249d47 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:21.549181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 70/140] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:21.555062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:21.626185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:21.692947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989a7b5-0ba0-48e1-b180-38573c25ddc4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:21.741676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3de256-2b7f-40ea-8be8-e9ce11d043e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:21.742290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3de256-2b7f-40ea-8be8-e9ce11d043e3 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:21.742577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3de256-2b7f-40ea-8be8-e9ce11d043e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:21.742860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3de256-2b7f-40ea-8be8-e9ce11d043e3 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:21.743634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3de256-2b7f-40ea-8be8-e9ce11d043e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:21.745091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3de256-2b7f-40ea-8be8-e9ce11d043e3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:21.783174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 71/141] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:21 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:22.334757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393796-fb28-425a-a0a8-a2f4b422904d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:22.335316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393796-fb28-425a-a0a8-a2f4b422904d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:22.335390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393796-fb28-425a-a0a8-a2f4b422904d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:22.336748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 71/142] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:22.342302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:22.342598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:22.342881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:22.367996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:22.378802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:22.541521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 72/143] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:22.582041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65393796-fb28-425a-a0a8-a2f4b422904d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:22.750223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65393796-fb28-425a-a0a8-a2f4b422904d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:22.823393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:22.825320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:22.825606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:22.825878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:22.845889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:22.857539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:22.858491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:22.859837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 72/144] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:22.865069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:22.951809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:23.057438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ecdc-fb80-4872-ab91-9a8cf00cf017 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:23.097453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:23.098136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:23.098459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:23.098734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:23.099505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:23.099811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:23.101251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:23.115489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 73/145] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:23.121703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:23.156651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:23.237825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ddd1b-a5a4-439f-a917-d912e4506151 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:23.275296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:23.276197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:23.276475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:23.276742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] PATH_INFO: `/v3/users/02242c89dad04a00be863c4aa3db1322` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:23.278056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] RBAC: Authorizing `identity:get_user(user_id=02242c89dad04a00be863c4aa3db1322)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:23.282322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:23.284440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 73/146] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:23 2022] GET /identity/v3/users/02242c89dad04a00be863c4aa3db1322 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:23.290162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:23.400400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:23.407655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ac6a-06d0-4178-a17d-118f74c9c9fc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:23.449590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26826904-da2b-47c5-aba7-e712b3498b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:23.450509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826904-da2b-47c5-aba7-e712b3498b99 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:23.450787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826904-da2b-47c5-aba7-e712b3498b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:23.451084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826904-da2b-47c5-aba7-e712b3498b99 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:23.452271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26826904-da2b-47c5-aba7-e712b3498b99 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:23.453792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26826904-da2b-47c5-aba7-e712b3498b99 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:23.455915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 74/147] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:23 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:23.462063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:23.569536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:23.579779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c879a-471a-466b-9d63-ecb935aad6ad None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:23.617249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab816442-348d-4d9b-b1c1-c03cd435d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:23.618167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab816442-348d-4d9b-b1c1-c03cd435d011 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:23.618444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab816442-348d-4d9b-b1c1-c03cd435d011 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:23.618721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab816442-348d-4d9b-b1c1-c03cd435d011 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/02242c89dad04a00be863c4aa3db1322/roles/8c92d030e061456db1d51b8f27c13df7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:23.620728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab816442-348d-4d9b-b1c1-c03cd435d011 None admin] RBAC: Authorizing `identity:create_grant(project_id=25ef1dfe56b347a2b0d8603d7447b428, user_id=02242c89dad04a00be863c4aa3db1322, role_id=8c92d030e061456db1d51b8f27c13df7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:23.622254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab816442-348d-4d9b-b1c1-c03cd435d011 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:23.646911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 74/148] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:23 2022] PUT /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/users/02242c89dad04a00be863c4aa3db1322/roles/8c92d030e061456db1d51b8f27c13df7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:23.713041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a3cec-5002-4b3a-aa43-54808f4c3f23 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:23.713379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a3cec-5002-4b3a-aa43-54808f4c3f23 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:23.713583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a3cec-5002-4b3a-aa43-54808f4c3f23 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:23.715104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 75/149] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:23.721876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:23.722175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:23.722429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:23.745563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:23.746888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:23.838199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:23.862458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a3cec-5002-4b3a-aa43-54808f4c3f23 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:23.980213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a3cec-5002-4b3a-aa43-54808f4c3f23 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:24.021354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6904a4f-2afb-48ba-98bf-318de6396584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:24.022182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904a4f-2afb-48ba-98bf-318de6396584 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.022462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904a4f-2afb-48ba-98bf-318de6396584 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.022736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904a4f-2afb-48ba-98bf-318de6396584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.034439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6904a4f-2afb-48ba-98bf-318de6396584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e6904a4f-2afb-48ba-98bf-318de6396584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:24.042279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:24.044390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:24.046277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:24.050864 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:24.091314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f581-0270-4dc3-8fdf-86838f21efe4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.091958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f581-0270-4dc3-8fdf-86838f21efe4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.092417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f581-0270-4dc3-8fdf-86838f21efe4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.094042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 77/152] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:24.099185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.100059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.100538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.126649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:24.131788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:24.158060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:24.204330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:24.231302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f16fc-8691-42e9-ae2f-2f54455ba783 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:24.238643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 78/153] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:24.282773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:24.282979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:24.283541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.283828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.284106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.284876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:24.285185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:24.286587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:24.299734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 76/154] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:24.305388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:24.446968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30be30c-e312-4622-b22b-18efc954a7d5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:24.455207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345a7e6-2fe4-4f2b-8371-5d8a22a9e0f2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:24.505144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:24.505965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.506250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.506525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] PATH_INFO: `/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.511735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] RBAC: Authorizing `identity:get_user(user_id=bd30b180b5054c1bbf1a42f4fe12ac4f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:24.513313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:24.515028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 77/155] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/users/bd30b180b5054c1bbf1a42f4fe12ac4f => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:24.520534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:24.522211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:24.523264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.523708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.524123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.542169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:24.544394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:24.552576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:24.553803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:24.554837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:24.563091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 79/156] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:24.564158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:24.597861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:24.668602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaa781-2303-4aa6-9bd0-099c7c26b292 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:24.724609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:24.725284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.725569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.725846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.828144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:24.829572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:24.837161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cb6a-f462-4245-a6fb-216263e77346 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:24.844803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:24.960307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:24.961386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.961894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.962373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.962471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:24.963458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:24.963682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:24.964194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:24.965885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a3917-0e51-4be5-bb70-fd95d73ebbf5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:24.985236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 80/158] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:24.987353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216e7-599f-4430-8c92-2f3a16a6ca45 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:24.987869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216e7-599f-4430-8c92-2f3a16a6ca45 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:24.988354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216e7-599f-4430-8c92-2f3a16a6ca45 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:24.990048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 81/159] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:24.990951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8216e7-599f-4430-8c92-2f3a16a6ca45 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:25.101906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88113-4acc-49f8-bb49-31929d071df6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:25.119021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:25.156818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283574cf-0e59-455d-8ea7-82a682ff907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:25.157986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283574cf-0e59-455d-8ea7-82a682ff907e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.158413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283574cf-0e59-455d-8ea7-82a682ff907e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.158821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283574cf-0e59-455d-8ea7-82a682ff907e None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.163725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283574cf-0e59-455d-8ea7-82a682ff907e None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:25.165384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283574cf-0e59-455d-8ea7-82a682ff907e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:25.167327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:25.168872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.169297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.169710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.199313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:25.200836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:25.222491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:25.301319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:25.302558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:25.303874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8216e7-599f-4430-8c92-2f3a16a6ca45 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:25.359774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:25.360959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.361501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.361964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.363400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:25.365051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:25.366909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 82/162] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:24 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:25.367862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:25.453914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67626b95-df83-4ff8-ac5b-26eb887a26a5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:25.473936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:25.522866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:25.524097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ab59e-bcb9-4d01-88da-30563a32a831 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:25.524544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.524998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.525446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.526474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=bd30b180b5054c1bbf1a42f4fe12ac4f) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:25.527039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:25.528802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:25.544698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:25 2022] GET /identity/v3/role_assignments?user.id=bd30b180b5054c1bbf1a42f4fe12ac4f&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:25.545957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:25.583213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:25.584079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.584365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.584641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.608611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:25.622250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:25.623196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:25.623982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:25.626032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:25.631826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:25.641750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:25.709858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77ecd5-cefd-4ae8-b3f5-d64937d90583 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:25.767769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f45f-e6cd-4460-b5b0-a1e5dc6fb6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:25.768461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f45f-e6cd-4460-b5b0-a1e5dc6fb6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.768745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f45f-e6cd-4460-b5b0-a1e5dc6fb6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.769018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f45f-e6cd-4460-b5b0-a1e5dc6fb6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.792255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c2638-423a-42f5-80c4-2fd3590f25ae None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:25.824904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:25.858199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:25.858891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.863229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.863702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.864637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:25.865095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:25.866679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549b473-25ee-44f8-93c9-6ddbfbb30c90 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:25.883212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f45f-e6cd-4460-b5b0-a1e5dc6fb6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:25.885064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f45f-e6cd-4460-b5b0-a1e5dc6fb6a8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:25.887211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 84/165] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:25.888930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793261bf-ba1b-4dcf-b5c8-968046fef6ff None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:25.889360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793261bf-ba1b-4dcf-b5c8-968046fef6ff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:25.889792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793261bf-ba1b-4dcf-b5c8-968046fef6ff None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:25.891813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 85/166] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:25.895897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793261bf-ba1b-4dcf-b5c8-968046fef6ff None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:26.038161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:26.070204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 82/167] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:26.072777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.073249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.076422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.100607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:26.102044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:26.129903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793261bf-ba1b-4dcf-b5c8-968046fef6ff None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:26.177144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:26.177959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.178237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.178508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.183923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:26.185633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:26.189044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:25 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:26.189830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:26.240504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 83/169] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:26.241383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:26.252246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:26.339105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6292e71-6401-4e75-841b-1a473e6f00ba None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:26.382948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:26.383863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.384140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.384467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.385663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:26.391282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:26.393336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 87/170] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:26 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:26.394105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:26.397335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:26.492460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f197-f83c-49b5-9e1c-db0f95fff1a5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:26.540712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:26.542102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.542522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.542947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.562066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45734-a1d7-435f-97a2-3961db2cf7f4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:26.632418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:26.633924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:26.635738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:26.636575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.636862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.637143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.637682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:26.671946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:26.688024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:26.688947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:26.689798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 88/171] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:26.690433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:26.784143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 84/172] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:26.789737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:26.856890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:26.934627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a3991-bbde-4e82-a5c1-76a0237db978 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:26.941300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:26.958372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee0a2-73d4-4e63-bc87-4d953c3d4b18 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:26.987976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:26.989050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.989596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.989877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.990646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:26.990958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:26.992486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:26.993346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:26.994192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:26.994612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:26.995080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:26.996070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=f9dbca93f4b04d93985c947947b1a2e2) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:26.996523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:26.998187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b5d78-ea25-4df7-ab08-2b70e70d74b8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:27.002620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:27.003717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.009133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:26 2022] GET /identity/v3/role_assignments?user.id=f9dbca93f4b04d93985c947947b1a2e2&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:27.010591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0b2a-3efb-412b-a205-a717acc27a5f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.011061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0b2a-3efb-412b-a205-a717acc27a5f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.011460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0b2a-3efb-412b-a205-a717acc27a5f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.012968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 90/175] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:27.014202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b54f-9149-472f-b969-796027a2b259 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.014618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b54f-9149-472f-b969-796027a2b259 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.015042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b54f-9149-472f-b969-796027a2b259 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.016490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 91/176] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:27.021437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b54f-9149-472f-b969-796027a2b259 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.204915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7d2a-38a2-44e0-8c48-63113641e548 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:27.205723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b54f-9149-472f-b969-796027a2b259 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:27.240930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.251526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66918-26cb-431d-a364-7617b7832c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:27.252747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66918-26cb-431d-a364-7617b7832c32 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.252968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857bd7-7edb-4173-b85a-2be2b9255a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:27.253348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66918-26cb-431d-a364-7617b7832c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.253760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66918-26cb-431d-a364-7617b7832c32 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.253915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857bd7-7edb-4173-b85a-2be2b9255a59 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.254243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857bd7-7edb-4173-b85a-2be2b9255a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.254517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857bd7-7edb-4173-b85a-2be2b9255a59 None admin] PATH_INFO: `/v3/users/f9dbca93f4b04d93985c947947b1a2e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.255756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1857bd7-7edb-4173-b85a-2be2b9255a59 None admin] RBAC: Authorizing `identity:get_user(user_id=f9dbca93f4b04d93985c947947b1a2e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:27.256444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b66918-26cb-431d-a364-7617b7832c32 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:27.257571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1857bd7-7edb-4173-b85a-2be2b9255a59 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:27.257910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b66918-26cb-431d-a364-7617b7832c32 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:27.260030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 92/178] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/users/f9dbca93f4b04d93985c947947b1a2e2 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:27.262588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 86/178] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:27.262588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.262588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.262588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.264449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.264914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.265624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.281944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:27.283996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:27.290074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:27.291324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:27.319378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.365886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:27.368305 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 93/180] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:27.369173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.370592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.469239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a52eaa-e39c-4219-95be-532a72d1bacd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:27.479211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d938c7-d512-4b76-a9c6-40459c4fcc6c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:27.491713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.503486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:27.504148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.504427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.504696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.512089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:27.512935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.513216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.513483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.514324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] RBAC: Adding query filter params (role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=f9dbca93f4b04d93985c947947b1a2e2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:27.514629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:27.516126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b663cd-d8ba-4737-a046-2ae8806facaa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:27.521882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 88/181] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/role_assignments?user.id=f9dbca93f4b04d93985c947947b1a2e2&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:27.523106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61d3d-2768-44c1-b5c4-ab746d5b0b4f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.523384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61d3d-2768-44c1-b5c4-ab746d5b0b4f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.523657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61d3d-2768-44c1-b5c4-ab746d5b0b4f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.525017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 89/182] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:27.525928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9292ea2-7737-43ef-bbb3-0a11fd179319 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.526213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9292ea2-7737-43ef-bbb3-0a11fd179319 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.526471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9292ea2-7737-43ef-bbb3-0a11fd179319 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.527917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 90/183] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:27.531980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9292ea2-7737-43ef-bbb3-0a11fd179319 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.568793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.596460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:27.597985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:27.654278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9292ea2-7737-43ef-bbb3-0a11fd179319 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:27.695861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9c66-05bd-428d-ad43-376aba63c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:27.696691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9c66-05bd-428d-ad43-376aba63c101 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.696970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9c66-05bd-428d-ad43-376aba63c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.697241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9c66-05bd-428d-ad43-376aba63c101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.709770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e9c66-05bd-428d-ad43-376aba63c101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:27.714361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 94/184] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:27.715324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-285e9c66-05bd-428d-ad43-376aba63c101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:27.718940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:27.719917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 91/185] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:27.725567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449abd4-5e98-453f-961b-5b34d65067be None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.726277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449abd4-5e98-453f-961b-5b34d65067be None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.726277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449abd4-5e98-453f-961b-5b34d65067be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.741294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a449abd4-5e98-453f-961b-5b34d65067be None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:27.742473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a449abd4-5e98-453f-961b-5b34d65067be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:27.750603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.810711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 92/186] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:27.812364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.812652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.812925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.827635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8b5c5-4e64-4c44-bf72-624fb5bf4259 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:27.837716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:27.838891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:27.852144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.862704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:27.863570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:27.863851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:27.864126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:27.874960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:27.883227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:27.884203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 95/187] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:27.885466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.910009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 93/188] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:27.915913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:27.969537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:27.985407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a300-3d11-4fb5-9134-33ab28dc7329 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.017356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bf5c5-181b-40c9-9570-a1a8dcb5c4e2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.019937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.020811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.021087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.021371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] PATH_INFO: `/v3/projects/61c190765f3e434c996ef403f411c2dc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.022577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] RBAC: Authorizing `identity:get_project(project_id=61c190765f3e434c996ef403f411c2dc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.024074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.025819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 96/189] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/projects/61c190765f3e434c996ef403f411c2dc => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.031123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.056000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.056699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.056953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.057226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.057987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:28.058297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.059735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.067838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 94/190] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.068613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.084075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.127560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cceaed-5117-4902-9ce8-6e4d196bb423 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.161342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.162140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.162405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.162673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.163875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.165377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.167045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 97/191] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.167806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.175492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131941c7-6b55-4d26-baf6-3012c46266f7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.188787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.210483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.211196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.211490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.211765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.212544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:28.212853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.214244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.222120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 95/192] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.222960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.266315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110397e7-ff72-4862-b247-de9a431fac97 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.290528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.301593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.302406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.302688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.302963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.313701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:28.319380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d0961-6227-4eb2-9ade-aaf003a49504 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:28.321925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:28.322828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:28.323620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 98/193] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:28.324252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.353515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.354177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.354469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.354739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.355615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=61c190765f3e434c996ef403f411c2dc, user.id=f9dbca93f4b04d93985c947947b1a2e2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:28.355930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.357447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.363288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 96/194] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/role_assignments?user.id=f9dbca93f4b04d93985c947947b1a2e2&scope.project.id=61c190765f3e434c996ef403f411c2dc&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.364041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.429721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.453671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a654-66c9-4e23-9553-9cd58eb93abc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.481574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acdbaa-b6ca-4bb0-b0d4-c1789eac857b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.492160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.493075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.493544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.493645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] PATH_INFO: `/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.510512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] RBAC: Authorizing `identity:get_user(user_id=57d97d0e223d4f529da7ef3bb99ccd6d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.512102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.514119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 99/195] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.514901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.527922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.529622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.529622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.529622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.530584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.531940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.544284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.564320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 97/196] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:28 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:28.564973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.647700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe789b-2e32-4700-b389-e81c00cce051 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.690896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.691844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.692123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.692394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] PATH_INFO: `/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.694457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] RBAC: Authorizing `identity:get_user(user_id=57d97d0e223d4f529da7ef3bb99ccd6d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.696651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.703344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 100/197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.703344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.712585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faf35e-2a67-489f-ab17-1172267df6a1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.714689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.754921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.755785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.756067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.756341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.757111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:28.757416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.758821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.768839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 98/198] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:28.769683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:28.822132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fb83f-69d4-4389-a909-370b835067f1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.834935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:28.864358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.865028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.865306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.865579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.897109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04e95-8af0-420d-ac61-80df7ab59f37 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:28.935463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:28.936134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:28.936420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:28.936697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:28.939482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:28.941136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:28.949624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.020575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.022664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.068969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 101/199] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:29.069834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.092016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.153808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 99/200] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:29.155514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.177323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31b17-0f0e-4309-ac16-0d268aec6e8a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.186308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.217239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.218168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.218451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.218728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] PATH_INFO: `/v3/users/02242c89dad04a00be863c4aa3db1322` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.219974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] RBAC: Authorizing `identity:get_user(user_id=02242c89dad04a00be863c4aa3db1322)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.221726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.223458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 102/201] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/users/02242c89dad04a00be863c4aa3db1322 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:29.224227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.283351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b48507-4afb-407e-ba42-82047e51c27e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.332258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.333678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.333966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.334389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.336005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.338212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.341146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 100/202] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:29.341930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.345931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3545-88fb-4f1a-a9ec-79df88846f10 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.373251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.395387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.396595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.397161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.397501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.398777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.400844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.403451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 103/203] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:29.404590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.456361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f77ef0-f8d2-4746-99bd-d2863eda8919 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.460334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.493902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.494815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.495287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.495704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.531800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dd3d1-80ab-4040-9a08-e3e63833a244 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.567277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.569047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.574901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.575663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.575948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.576223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.577072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=57d97d0e223d4f529da7ef3bb99ccd6d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:29.577381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.579355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.586831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 104/204] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/role_assignments?user.id=57d97d0e223d4f529da7ef3bb99ccd6d&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:29.587706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.597655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.753528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 101/205] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:29.759582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:29.770668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d362f-f1b5-4448-a9b9-dd65142b7ee0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.779630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.819877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.820550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.820831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.821108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.822016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] RBAC: Adding query filter params (role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=57d97d0e223d4f529da7ef3bb99ccd6d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:29.822334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.824008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.841805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 105/206] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/role_assignments?user.id=57d97d0e223d4f529da7ef3bb99ccd6d&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:29.898123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad606c-67a3-4804-8ee1-2cd447c2b174 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:29.939630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.953632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed75517-46a3-4936-9176-a49e47417734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:29.954548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75517-46a3-4936-9176-a49e47417734 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:29.954836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75517-46a3-4936-9176-a49e47417734 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:29.955136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed75517-46a3-4936-9176-a49e47417734 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:29.956373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed75517-46a3-4936-9176-a49e47417734 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:29.957976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed75517-46a3-4936-9176-a49e47417734 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:29.960184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 102/207] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:29.966373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:30.105823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754f6c-ef18-4281-890f-34a3850f51e2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:30.144683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:30.145721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:30.146199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:30.146682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:30.147776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] RBAC: Adding query filter params (role.id=8c92d030e061456db1d51b8f27c13df7, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428, user.id=02242c89dad04a00be863c4aa3db1322) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:30.148386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:30.150154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf421e-60d2-43b6-8020-99778ef52482 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:30.157158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 106/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:29 2022] GET /identity/v3/role_assignments?user.id=02242c89dad04a00be863c4aa3db1322&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=8c92d030e061456db1d51b8f27c13df7 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:30.993109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7bce7-a574-484e-b202-7329af1a06a4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:30.993672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7bce7-a574-484e-b202-7329af1a06a4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:30.993672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7bce7-a574-484e-b202-7329af1a06a4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:30.995077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 103/209] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:31.002218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.003075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.003576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.020922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:31.022442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:31.025751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36807-21db-440b-b927-50167782deb6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.026040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36807-21db-440b-b927-50167782deb6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.026321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36807-21db-440b-b927-50167782deb6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.027981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 104/210] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:31.033427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852004-809c-4711-b45c-acd448a15996 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.033708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852004-809c-4711-b45c-acd448a15996 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.033984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9852004-809c-4711-b45c-acd448a15996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.050475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f9852004-809c-4711-b45c-acd448a15996 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:31.051718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f9852004-809c-4711-b45c-acd448a15996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:31.053036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:31.099909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 107/211] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:31.125126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:31.129277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:31.153998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852004-809c-4711-b45c-acd448a15996 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:31.240750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc348a-bbdd-49a5-ad69-058bc1532319 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:31.270125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9852004-809c-4711-b45c-acd448a15996 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:31.276719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:31.277707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.278056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.278427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.290038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:31.291042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:31.299638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:31.300677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:31.301645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:31.307795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 108/213] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:24:31.307932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:31.307932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.307932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.307932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.309643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:31.310307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:31.311794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:31.313445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 106/214] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:31.318755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:31.337511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:31.422384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e59a2-b130-48a5-8598-a43b0d526efa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:31.423161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa294653-d19c-409a-91eb-1cd92dc377b2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:31.457641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:31.458106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:31.458756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.458976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.459352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.459469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.459796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.459996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.460685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:31.461025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:31.461476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:31.462394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:31.463193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:31.478900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 109/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:31.480493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:31.494049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 107/216] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:31 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:31.581547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:31.598361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627e0d-fea7-4788-ac3f-2797da6412d1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:31.635767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914a6a8-10bf-4a90-9486-f856df246d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:31.636681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a6a8-10bf-4a90-9486-f856df246d38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.636960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a6a8-10bf-4a90-9486-f856df246d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.637229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914a6a8-10bf-4a90-9486-f856df246d38 None admin] PATH_INFO: `/v3/users/6df62df324434e8d90b6d785933c4f87` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.652522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a6a8-10bf-4a90-9486-f856df246d38 None admin] RBAC: Authorizing `identity:get_user(user_id=6df62df324434e8d90b6d785933c4f87)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:31.654145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914a6a8-10bf-4a90-9486-f856df246d38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:31.659085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 110/217] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:31 2022] GET /identity/v3/users/6df62df324434e8d90b6d785933c4f87 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:31.662271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:31.713678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:31.773520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94898c-5baf-43df-a1ae-97507ca922ad None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:31.812767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:31.813434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.813713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.813987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.835629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1875e-edfd-4009-96d2-ab3b71895d84 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.836225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1875e-edfd-4009-96d2-ab3b71895d84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.837117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1875e-edfd-4009-96d2-ab3b71895d84 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.838729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 111/218] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:31.845119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943447-3208-4aff-916c-421e505de51e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:31.845796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943447-3208-4aff-916c-421e505de51e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:31.846075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943447-3208-4aff-916c-421e505de51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:31.872367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0f943447-3208-4aff-916c-421e505de51e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:31.873700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0f943447-3208-4aff-916c-421e505de51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:31.893524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:31.895496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:31.956786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:31.959855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 112/219] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:31.985734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943447-3208-4aff-916c-421e505de51e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.027396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 108/220] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:32.035547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.109325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:32.152106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943447-3208-4aff-916c-421e505de51e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.190957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b48b-d9b2-478f-97ab-218f955ab8ba None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.197186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b9637-248f-49f3-8cc0-b003acb73b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.198099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9637-248f-49f3-8cc0-b003acb73b29 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.198937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9637-248f-49f3-8cc0-b003acb73b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.199310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b9637-248f-49f3-8cc0-b003acb73b29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.214613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b9637-248f-49f3-8cc0-b003acb73b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-079b9637-248f-49f3-8cc0-b003acb73b29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:32.225933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:32.226833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:32.227828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:32.229577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe32e2-24e2-4dc1-bd56-2f8e020da4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.230567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe32e2-24e2-4dc1-bd56-2f8e020da4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.230955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe32e2-24e2-4dc1-bd56-2f8e020da4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.231370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe32e2-24e2-4dc1-bd56-2f8e020da4f0 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.232151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 113/221] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:24:32.232834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe32e2-24e2-4dc1-bd56-2f8e020da4f0 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:32.233573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d5409-4a1f-4e29-950f-4f51686489f9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.233909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d5409-4a1f-4e29-950f-4f51686489f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.234192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d5409-4a1f-4e29-950f-4f51686489f9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.234653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe32e2-24e2-4dc1-bd56-2f8e020da4f0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:32.235554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 114/222] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:32.236811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 109/223] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:32.240959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d5409-4a1f-4e29-950f-4f51686489f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.247775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.248058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.248328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.268734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:32.269946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:32.278129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:32.340088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 110/224] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:32.347441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.380518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d5409-4a1f-4e29-950f-4f51686489f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.418218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.419378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.419880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.420345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.421455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:32.421962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:32.423679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:32.425441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:32.440045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 115/225] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:32.441273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.463435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79167dd7-b651-4af8-a731-eb78c1c61586 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.498479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.499217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.499520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.499842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.500637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=6df62df324434e8d90b6d785933c4f87) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:32.500946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:32.502486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:32.515018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/role_assignments?user.id=6df62df324434e8d90b6d785933c4f87&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:32.515018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.531377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:32.641652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27eb3-3204-4346-bd9e-c21bb9d7625d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.657639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a42aad-afd2-45c8-a447-45c53b15d7ca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.680586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.681697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.681802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.682070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] PATH_INFO: `/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.683331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] RBAC: Authorizing `identity:get_user(user_id=57d97d0e223d4f529da7ef3bb99ccd6d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:32.684840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:32.686504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 112/227] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:32.694308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.716224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.717090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.717369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.717642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.732954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:32.744499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:32.745651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:32.746455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 116/228] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:32.750608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.847095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:32.862155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:32.874231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82cb0-a403-4a65-9401-318f41ffd75e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:32.915742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:32.916545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:32.916823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:32.917096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:32.919238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:32.920709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:32.925815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 113/229] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:32.930685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:32.977494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52295074-7fe4-4094-ba5a-8300f67b57d7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:33.038508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:33.039219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:33.039500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:33.039772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:33.040531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:33.040840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:33.042237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:33.063883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 117/230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:33.071602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:33.115943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c59cc-3049-4eb5-a7f4-7abf4e7ea191 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:33.160238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:33.161151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:33.161433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:33.161704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0/users/57d97d0e223d4f529da7ef3bb99ccd6d/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:33.165199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d608fc3e544ac08d522367867a17c0, user_id=57d97d0e223d4f529da7ef3bb99ccd6d, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:33.168995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:33.198675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 114/231] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:32 2022] PUT /identity/v3/projects/55d608fc3e544ac08d522367867a17c0/users/57d97d0e223d4f529da7ef3bb99ccd6d/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:24:33.240636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d005-0bf5-46f2-b8ce-12f82617ac1d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:33.260736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:33.284964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:33.285941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:33.286225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:33.286497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] PATH_INFO: `/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:33.287841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] RBAC: Authorizing `identity:get_user(user_id=57d97d0e223d4f529da7ef3bb99ccd6d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:33.289398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:33.291312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 118/232] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:33 2022] GET /identity/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:33.297473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:33.300652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:33.434780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06bb8a-aedc-4786-8e57-a0964efd97a6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:33.476681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca25b0-ea91-481f-8b21-7bf6f6719b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:33.477926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca25b0-ea91-481f-8b21-7bf6f6719b07 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:33.478424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca25b0-ea91-481f-8b21-7bf6f6719b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:33.478886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca25b0-ea91-481f-8b21-7bf6f6719b07 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:33.480441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca25b0-ea91-481f-8b21-7bf6f6719b07 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:33.482176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca25b0-ea91-481f-8b21-7bf6f6719b07 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:33.484155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 115/233] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:33 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:33.490176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:33.650659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225f13-86f8-4d27-9775-b98b1e7f7503 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:33.706629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5de6b-d0cc-4886-8095-144910a2b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:33.707588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5de6b-d0cc-4886-8095-144910a2b00a None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:33.707877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5de6b-d0cc-4886-8095-144910a2b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:33.708157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5de6b-d0cc-4886-8095-144910a2b00a None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0/users/57d97d0e223d4f529da7ef3bb99ccd6d/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:33.710453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5de6b-d0cc-4886-8095-144910a2b00a None admin] RBAC: Authorizing `identity:create_grant(project_id=55d608fc3e544ac08d522367867a17c0, user_id=57d97d0e223d4f529da7ef3bb99ccd6d, role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:33.712084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5de6b-d0cc-4886-8095-144910a2b00a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:33.740315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:33 2022] PUT /identity/v3/projects/55d608fc3e544ac08d522367867a17c0/users/57d97d0e223d4f529da7ef3bb99ccd6d/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:24:34.011714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727efd-b297-47ca-8ed0-e7f76ed64add None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.012063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727efd-b297-47ca-8ed0-e7f76ed64add None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.012232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727efd-b297-47ca-8ed0-e7f76ed64add None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.013931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 116/235] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:34.020743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83b03-38da-4bda-a8c6-f664b2c11adb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.021032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83b03-38da-4bda-a8c6-f664b2c11adb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.021313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83b03-38da-4bda-a8c6-f664b2c11adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.041067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d8d83b03-38da-4bda-a8c6-f664b2c11adb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:34.042290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d8d83b03-38da-4bda-a8c6-f664b2c11adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:34.090853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:34.120548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 120/236] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:34.123358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fbe96-fcf5-4658-afce-048e7d88dbad None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.124206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fbe96-fcf5-4658-afce-048e7d88dbad None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.124673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fbe96-fcf5-4658-afce-048e7d88dbad None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.126551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 117/237] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:34.135017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.135017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.135017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.145286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fbe96-fcf5-4658-afce-048e7d88dbad None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:34.153821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:34.155155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:34.274747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 121/238] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:34.286399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:34.319026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:34.330198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fbe96-fcf5-4658-afce-048e7d88dbad None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:34.404794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:34.405970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.406247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.406515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.427928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:34.443710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:34.444615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:34.445385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 118/239] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:34.453909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:34.505182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c21e62-7796-41b6-ab8c-bf957f3ac073 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:34.516492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:34.565698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3cde-641a-4778-8886-24ba1d451bfe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:34.595353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:34.603748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:34.604532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.604828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.605107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.606784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:34.606784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:34.607869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:34.610134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:34.610958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.611406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.611683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.615764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:34.617241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:34.617650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 119/240] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:34.619193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 122/241] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:34.623500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:34.624286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:34.728390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e958-3c73-4d76-86d4-32072f69a334 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:34.778618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0abd2-1431-4849-b293-f95b2021cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:34.780103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0abd2-1431-4849-b293-f95b2021cc9e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.780949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0abd2-1431-4849-b293-f95b2021cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.781413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0abd2-1431-4849-b293-f95b2021cc9e None admin] PATH_INFO: `/v3/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.789041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd49ec5-ae70-4f49-8c40-80334e50cadc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:34.804880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0abd2-1431-4849-b293-f95b2021cc9e None admin] RBAC: Authorizing `identity:get_user(user_id=dfa622dfbc4a46bf834b7e2c3ca7a6b2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:34.806711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0abd2-1431-4849-b293-f95b2021cc9e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:34.809026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 120/242] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:34 2022] GET /identity/v3/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:34.810532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362920-e701-44ed-85fa-91842b29d9f4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.811046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362920-e701-44ed-85fa-91842b29d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.811550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362920-e701-44ed-85fa-91842b29d9f4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.813263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 121/243] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:34.818347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362920-e701-44ed-85fa-91842b29d9f4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:34.835122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3db9c4-e6bf-436b-9ef9-4918cf865845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:34.836238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3db9c4-e6bf-436b-9ef9-4918cf865845 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.836711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3db9c4-e6bf-436b-9ef9-4918cf865845 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.837200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3db9c4-e6bf-436b-9ef9-4918cf865845 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.838160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3db9c4-e6bf-436b-9ef9-4918cf865845 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:34.840088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3db9c4-e6bf-436b-9ef9-4918cf865845 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:34.865696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 123/244] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:34 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:24:34.867451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.867958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.868762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.883410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:34.895267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:34.897429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:34.930951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:34.941073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362920-e701-44ed-85fa-91842b29d9f4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:34.980744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:34.981336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:34.981692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:34.981931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:34.993634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 124/245] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:35.041407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.098545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:35.100471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:35.179540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:35.193684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670fdfc-7c01-4d9b-9839-4c5d3c896c8d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:35.235523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:35.236342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:35.236622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:35.236894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:35.250031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:35.251299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 122/246] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:35.260873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:35.262281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:35.263287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:35.264061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 125/247] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:35.270620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.295789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:35.397860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7425d-562a-4fd6-aa51-34b227cf4cd7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:35.431808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115576-26dd-4c4f-9ab5-6cc742043555 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:35.445651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:35.446893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:35.447454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:35.447890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:35.448719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:35.449114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:35.451390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:35.465868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 126/248] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:35.474852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.487029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:35.488611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:35.489082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:35.489541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:35.491515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:35.493678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:35.496409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 123/249] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:35 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:35.502366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.527674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:35.581758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:35.605813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4ae9-198d-4569-8d03-e5ef9d81c228 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:35.631031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1b56-9176-4b30-b8b1-a8e4481e7322 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:35.640398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:35.641589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:35.642075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:35.642530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] PATH_INFO: `/v3/users/6df62df324434e8d90b6d785933c4f87` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:35.643982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] RBAC: Authorizing `identity:get_user(user_id=6df62df324434e8d90b6d785933c4f87)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:35.645650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:35.647606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 127/250] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:35 2022] GET /identity/v3/users/6df62df324434e8d90b6d785933c4f87 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:35.654269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.671038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:35.671038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:35.671038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:35.671038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:35.671427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] RBAC: Adding query filter params (role.id=8c92d030e061456db1d51b8f27c13df7, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=dfa622dfbc4a46bf834b7e2c3ca7a6b2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:35.671427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:35.671550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:35.677859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 124/251] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:35 2022] GET /identity/v3/role_assignments?user.id=dfa622dfbc4a46bf834b7e2c3ca7a6b2&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=8c92d030e061456db1d51b8f27c13df7 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:35.798462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce9a07-746f-47cb-9053-42d8d35d2c0d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:35.847779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514a23-a04d-454a-b9c2-54eb877de2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:35.848684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514a23-a04d-454a-b9c2-54eb877de2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:35.848964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514a23-a04d-454a-b9c2-54eb877de2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:35.849242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514a23-a04d-454a-b9c2-54eb877de2a4 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:35.850573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf514a23-a04d-454a-b9c2-54eb877de2a4 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:35.852296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf514a23-a04d-454a-b9c2-54eb877de2a4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:35.854256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 128/252] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:35 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:35.860371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:35.951301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:35.969368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7e7b6-e79f-441b-9cf7-a4b8bf5f08c6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:36.004684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9826b-c99e-48f2-8c9e-2af5cb701a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:36.005603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9826b-c99e-48f2-8c9e-2af5cb701a07 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.005882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9826b-c99e-48f2-8c9e-2af5cb701a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.006158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9826b-c99e-48f2-8c9e-2af5cb701a07 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0/users/6df62df324434e8d90b6d785933c4f87/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.008176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9826b-c99e-48f2-8c9e-2af5cb701a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d608fc3e544ac08d522367867a17c0, user_id=6df62df324434e8d90b6d785933c4f87, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:36.009651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9826b-c99e-48f2-8c9e-2af5cb701a07 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:36.033012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 125/253] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:35 2022] PUT /identity/v3/projects/55d608fc3e544ac08d522367867a17c0/users/6df62df324434e8d90b6d785933c4f87/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:36.057605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f5d8-65e3-4181-a0d7-d6d7d14e12ae None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.057919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f5d8-65e3-4181-a0d7-d6d7d14e12ae None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.058255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062f5d8-65e3-4181-a0d7-d6d7d14e12ae None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.060041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 129/254] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:36.066088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.066375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.066651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.085044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:36.086323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:36.177947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 126/255] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:36.214708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f5d8-65e3-4181-a0d7-d6d7d14e12ae None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:36.244279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:36.348129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062f5d8-65e3-4181-a0d7-d6d7d14e12ae None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:36.412843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e7751-fa9b-44b2-83fe-c10b932fc720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:36.413675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7751-fa9b-44b2-83fe-c10b932fc720 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.413952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7751-fa9b-44b2-83fe-c10b932fc720 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.414305 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e7751-fa9b-44b2-83fe-c10b932fc720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.429276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e7751-fa9b-44b2-83fe-c10b932fc720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-672e7751-fa9b-44b2-83fe-c10b932fc720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:36.437240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:36.438542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:36.439780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 130/256] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:36.445301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:36.458567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f836f-bff3-47f7-bab9-7f77e17c677e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.458930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f836f-bff3-47f7-bab9-7f77e17c677e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.459172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f836f-bff3-47f7-bab9-7f77e17c677e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.460816 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 131/257] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:36.485316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.485587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.485777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.512400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:36.513669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:36.529426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:36.560334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a4fef-ea90-4563-a37e-628d56370884 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:36.612412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:36.613102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.613386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.613661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.614427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:36.614731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:36.616291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:36.629394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 127/258] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:36.638695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:36.684518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:36.772497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:36.778463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ede45-afb8-4280-a5cc-2fb0471e8cc3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:36.793013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:36.826194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:36.827230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:36.827515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:36.827791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] PATH_INFO: `/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:36.831829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=57d97d0e223d4f529da7ef3bb99ccd6d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:36.833338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:36.835214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 128/260] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:36 2022] GET /identity/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:36.840796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:36.843962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:37.020128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f0e0-159a-46db-9aad-0ea48f200c86 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.069838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800459-d087-4ea0-977c-2f69cb6d6ef7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.088558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:37.089395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:37.089677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:37.089952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:37.118058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:37.133270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:37.134288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:37.135575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 133/261] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:37.141233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:37.142824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:37.148629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:37.148629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:37.148629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:37.287453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:37.299419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:37.300921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:37.303328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:37.342062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160c8b-4a25-4549-b156-589f9a782872 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.439770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:37.440659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:37.440769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:37.441082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:37.441857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:37.442171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:37.443697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:37.457634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 134/262] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:37.468003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:37.521793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 129/263] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:37.529669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:37.631754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba43dc-4d50-4613-82e9-2588c8d1391e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.673575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:37.703724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:37.704704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:37.704987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:37.705258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] PATH_INFO: `/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:37.706605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] RBAC: Authorizing `identity:get_user(user_id=57d97d0e223d4f529da7ef3bb99ccd6d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:37.708205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:37.710275 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 135/264] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:37 2022] GET /identity/v3/users/57d97d0e223d4f529da7ef3bb99ccd6d => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:37.716135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:37.730195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135683-0ee8-4a4d-a8b2-ae3d3cebd83e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.744705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:37.789542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:37.790548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:37.790836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:37.791144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:37.792342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:37.800532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:37.802644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 130/265] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:37 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:37.815906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:37.909365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207d75-ec7d-45e0-8cb2-ddfd594a05bc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.982031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee654f4-4532-42f0-93f2-282e560c2393 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:37.984349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:37.985027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:37.985315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:37.985597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.029294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:38.029968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.030251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.030888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.031771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=57d97d0e223d4f529da7ef3bb99ccd6d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:38.032084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:38.033571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422a7a7-f8b3-494d-a5fd-2f09f6a4cf6d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:38.040272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 131/266] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:37 2022] GET /identity/v3/role_assignments?user.id=57d97d0e223d4f529da7ef3bb99ccd6d&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:38.041572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f1dfa-7412-49b9-a0a5-b89d934047ff None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.041856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f1dfa-7412-49b9-a0a5-b89d934047ff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.042136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f1dfa-7412-49b9-a0a5-b89d934047ff None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.052579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 132/267] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:38.058734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.059064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.059327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.092356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:38.093614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:38.158434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:38.169344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:38.177218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:38.180103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:38.244505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 133/268] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:38.283202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:38.386816 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 136/269] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:38.396577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:38.508265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c4ace-a306-4c1c-a2c5-bd1d75a94fc5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:38.525770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:38.525770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d53e-93a4-4a14-86d4-5f056e375c30 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:38.554124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:38.554947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.555260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.555532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.579832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:38.589469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:38.590330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:38.591203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:38.593120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 134/270] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:38.598031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:38.598919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.599229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.599503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.600877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:38.601895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:38.603534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:38.605412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 137/271] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:38 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:38.616022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:38.660189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:38.750929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa52342-5168-4206-9b62-d5d977aa47f4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:38.774979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a6af7-1a50-4acb-9479-f8e11bc71357 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:38.794751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:38.795934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.796359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.796798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.797693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:38.798545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:38.800405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5666b-dc42-49be-81b3-3d49397df978 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:38.811523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 135/272] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:38.812933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81442f4-a889-4de6-b181-5c99c75f7b03 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.813219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81442f4-a889-4de6-b181-5c99c75f7b03 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.813494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81442f4-a889-4de6-b181-5c99c75f7b03 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.815019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 136/273] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:38.819831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:38.820074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6127b-bc0a-4738-ba47-46bd930fa487 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.820307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6127b-bc0a-4738-ba47-46bd930fa487 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.820583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6127b-bc0a-4738-ba47-46bd930fa487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.821321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.821790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.822456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.823432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] RBAC: Adding query filter params (role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=57d97d0e223d4f529da7ef3bb99ccd6d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:38.823745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:38.825200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:38.833294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 138/274] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:38 2022] GET /identity/v3/role_assignments?user.id=57d97d0e223d4f529da7ef3bb99ccd6d&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:38.834323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:38.837925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-43c6127b-bc0a-4738-ba47-46bd930fa487 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:38.839293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-43c6127b-bc0a-4738-ba47-46bd930fa487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:38.888603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:38.937609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 137/275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:38.939530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450b35-1d6b-43fb-ab64-eb447ca4a033 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.940158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450b35-1d6b-43fb-ab64-eb447ca4a033 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.940622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450b35-1d6b-43fb-ab64-eb447ca4a033 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.942200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 138/276] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:38.950153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cee36-2833-4b76-87d0-430040833078 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:38.950153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cee36-2833-4b76-87d0-430040833078 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:38.950153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cee36-2833-4b76-87d0-430040833078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:38.974975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-df9cee36-2833-4b76-87d0-430040833078 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:38.976238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-df9cee36-2833-4b76-87d0-430040833078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:38.990125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:38.991902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778742a2-b5f4-44d5-b226-37ef2970161f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.039080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.039903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.040179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.040456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] PATH_INFO: `/v3/users/c4d8fe5a80134785a2610b12d47701ba` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.054446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d8fe5a80134785a2610b12d47701ba)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.056019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.059061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 139/277] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:38 2022] GET /identity/v3/users/c4d8fe5a80134785a2610b12d47701ba => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:39.059205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 139/278] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:39.059286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.063173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157c5e-52e2-41a6-8252-39ab91c88bd1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.063173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157c5e-52e2-41a6-8252-39ab91c88bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.063173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157c5e-52e2-41a6-8252-39ab91c88bd1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.063173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 140/279] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:39.066585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157c5e-52e2-41a6-8252-39ab91c88bd1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.151405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:39.163937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156bcc-24e1-4076-8a06-37a4d59e99f6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.171534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157c5e-52e2-41a6-8252-39ab91c88bd1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.197249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba89cb-7f36-4da2-85f1-96d81775b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.198055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba89cb-7f36-4da2-85f1-96d81775b31c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.198337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba89cb-7f36-4da2-85f1-96d81775b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.198615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba89cb-7f36-4da2-85f1-96d81775b31c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.199819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba89cb-7f36-4da2-85f1-96d81775b31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.201307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba89cb-7f36-4da2-85f1-96d81775b31c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.202943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 140/280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:39.204101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.204391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.204670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.205198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.205883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.206131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.206405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.207282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, user.id=c4d8fe5a80134785a2610b12d47701ba, scope.system=all) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:39.207655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.209126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.214412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 141/281] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/role_assignments?user.id=c4d8fe5a80134785a2610b12d47701ba&scope.system=all&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:39.215214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.221346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:39.222581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:39.233029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:39.300218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 141/282] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:39.301015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.345439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0f107-7dbe-489a-a17c-b6ca255ffbdd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.383567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.384398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.384682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.384957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.396368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:39.404390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:39.405252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 142/283] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:39.411740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.416214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:39.428958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0ba6-3dca-4d7b-8eb0-4e43f9199b9c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.464084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.464862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.465242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.465576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.466380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.467933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.487673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:39.503379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 142/284] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:24:39 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:39.504233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.532092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772e32a-7356-4085-b937-fe7b57222837 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.588294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.590487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.591337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.591789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.608054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:39.619441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:39.620584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:39.621521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:39.624451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 143/285] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:39.630217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.633979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c776c-da1e-4946-9ba3-dc00298f6cb2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.680984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203a152-2d13-49da-9632-37056165e111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.681671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203a152-2d13-49da-9632-37056165e111 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.681948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203a152-2d13-49da-9632-37056165e111 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.682220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203a152-2d13-49da-9632-37056165e111 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.682976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203a152-2d13-49da-9632-37056165e111 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:39.683312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203a152-2d13-49da-9632-37056165e111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.684724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203a152-2d13-49da-9632-37056165e111 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.695143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 143/286] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:39.699971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203a152-2d13-49da-9632-37056165e111 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.705033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:39.767328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607708b-86bb-48ba-8fc8-5c92f96c8de6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.803742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:39.812800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.813510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.813775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.814053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.814819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:39.815183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.816602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.826766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203a152-2d13-49da-9632-37056165e111 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.831184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 144/287] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:39.835363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.864213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:39.865043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:39.865331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:39.865603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] PATH_INFO: `/v3/users/6df62df324434e8d90b6d785933c4f87` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:39.866844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] RBAC: Authorizing `identity:get_user(user_id=6df62df324434e8d90b6d785933c4f87)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:39.868742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:39.871227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 144/288] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/users/6df62df324434e8d90b6d785933c4f87 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:39.876444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:39.960995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e518d-32fe-42bc-bda5-b845d4fdc4b3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:39.970908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:40.009945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:40.011016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:40.011251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269dfc-4293-4c0d-a85a-dc3002ba009e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:40.011514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:40.011872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] PATH_INFO: `/v3/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:40.013631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] RBAC: Authorizing `identity:get_user(user_id=dfa622dfbc4a46bf834b7e2c3ca7a6b2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:40.016235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:40.018368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 145/289] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:40.023499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:40.078659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:40.079367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:40.079650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:40.079928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:40.137248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:40.216936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:40.218444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:40.222021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e2681-2f26-43f7-9424-57d60bcd347f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:40.300318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:40.301617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:40.302087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:40.302546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:40.305166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:40.307755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:40.309276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:40.311603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:40 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:40.317504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:40.374199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 145/291] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:40.382985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:40.429796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb1f9d-ecdf-499a-9533-8c25ec45b467 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:40.459210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:40.473564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:40.474476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:40.474752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:40.475038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2/roles/8c92d030e061456db1d51b8f27c13df7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:40.477958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d608fc3e544ac08d522367867a17c0, user_id=dfa622dfbc4a46bf834b7e2c3ca7a6b2, role_id=8c92d030e061456db1d51b8f27c13df7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:40.479567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:40.501687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:24:40 2022] PUT /identity/v3/projects/55d608fc3e544ac08d522367867a17c0/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2/roles/8c92d030e061456db1d51b8f27c13df7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:40.561930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9119-44fc-4dcf-bcc6-140a93508ff6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:40.599188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048baeb-6951-4c69-bafd-4b9a2bfdc515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:40.600177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048baeb-6951-4c69-bafd-4b9a2bfdc515 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:40.600455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048baeb-6951-4c69-bafd-4b9a2bfdc515 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:40.600726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048baeb-6951-4c69-bafd-4b9a2bfdc515 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:40.602061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048baeb-6951-4c69-bafd-4b9a2bfdc515 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:40.603641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048baeb-6951-4c69-bafd-4b9a2bfdc515 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:40.605833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 146/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:40 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:40.611496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:40.732740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8214c1-4b88-489d-b636-884379e42e49 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:40.766807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:40.767501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:40.767780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:40.768048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:40.768880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=6df62df324434e8d90b6d785933c4f87) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:40.769186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:40.770624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae1458-4a3d-40ff-b7d2-c272ad8b639c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:40.777123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 148/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:40 2022] GET /identity/v3/role_assignments?user.id=6df62df324434e8d90b6d785933c4f87&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:41.394584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ee07-eabc-4259-b525-00642b7d147c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:41.395620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ee07-eabc-4259-b525-00642b7d147c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:41.396111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0ee07-eabc-4259-b525-00642b7d147c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:41.397948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 147/295] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:41.405398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:41.406265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:41.406765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:41.428682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:41.430093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:41.489172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:41.514452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 149/296] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:41.537305 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0ee07-eabc-4259-b525-00642b7d147c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:41.587914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:41.647244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0ee07-eabc-4259-b525-00642b7d147c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:41.681348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:41.682202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:41.682522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:41.682799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:41.695717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:41.704187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:41.705081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:41.705844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 148/297] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:41.712803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:41.815429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d839c5-7696-4c70-b945-846e6f3c299d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:41.853964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:41.854638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:41.854913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:41.855212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:41.855966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:41.856266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:41.857699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b538b-a81c-4d1c-bea9-524177a190ab None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:41.866417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 150/298] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:41.872199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:41.958530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fab5d-8f35-45b5-9814-1d0a0309632c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:41.958853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fab5d-8f35-45b5-9814-1d0a0309632c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:41.959128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fab5d-8f35-45b5-9814-1d0a0309632c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:41.960526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 151/299] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:41.965887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32b769-4908-4c36-9cef-0c6899d875e5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:41.966173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32b769-4908-4c36-9cef-0c6899d875e5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:41.966580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32b769-4908-4c36-9cef-0c6899d875e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:41.970850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:41.975768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee28d-06c7-46f4-ab6c-ab0f9bcf3d3b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:41.985539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0f32b769-4908-4c36-9cef-0c6899d875e5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:41.986779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0f32b769-4908-4c36-9cef-0c6899d875e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:42.024336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.025347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.025628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.025899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] PATH_INFO: `/v3/users/c4d8fe5a80134785a2610b12d47701ba` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.027629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d8fe5a80134785a2610b12d47701ba)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.029249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.031504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 149/300] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:41 2022] GET /identity/v3/users/c4d8fe5a80134785a2610b12d47701ba => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:42.037320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.045789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:42.075027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 152/301] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:42.084404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98586ff6-a531-4e86-9e5f-96679c3afdff None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.084757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98586ff6-a531-4e86-9e5f-96679c3afdff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.085044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98586ff6-a531-4e86-9e5f-96679c3afdff None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.086350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 153/302] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:42.092940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.093496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.093911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.116730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:42.118125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:42.146017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e44f-45c3-45dc-a8bb-32d2b8b49f50 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.182358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.183269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.183557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.183834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] PATH_INFO: `/v3/system/users/c4d8fe5a80134785a2610b12d47701ba/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.185473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c4d8fe5a80134785a2610b12d47701ba, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.186865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.195579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 154/303] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:42.207181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.212946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 150/304] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jul 21 22:24:42 2022] PUT /identity/v3/system/users/c4d8fe5a80134785a2610b12d47701ba/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:24:42.220887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.259425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:42.350783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c38b1-f970-4685-b5c8-4b01a30fc030 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.355143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:42.359546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f631f5-6243-4bbd-a9e8-44683d8e5b59 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.411431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.412575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.412914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.413258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.418670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.419792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.420143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.420677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.422276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.424018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:42.424143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.426005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 151/305] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:42.431841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:42.432043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:42.432971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:42.433845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 155/306] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:42.440356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.543561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888397c-73d5-4539-a9b6-c0968926873a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.543739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46fae0-82fc-4105-9294-8fd64e5f5612 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.545488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:42.579221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.580138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.580425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.580701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.581574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:42.581939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.583579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.584180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.585178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.585462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.585763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] PATH_INFO: `/v3/groups` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.586876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.588365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.594017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 156/307] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:42.601280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.617053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 152/308] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jul 21 22:24:42 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:24:42.637876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:42.724628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f72b1b-a902-4ba0-9c0f-74d2a007f0fb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.767954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09a6c4-734d-4987-a587-6cbda98b7461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.768923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a6c4-734d-4987-a587-6cbda98b7461 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.769198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a6c4-734d-4987-a587-6cbda98b7461 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.769468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a6c4-734d-4987-a587-6cbda98b7461 None admin] PATH_INFO: `/v3/users/83fc3e633c334fc5b44842d6590c68ee` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.786335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a6c4-734d-4987-a587-6cbda98b7461 None admin] RBAC: Authorizing `identity:get_user(user_id=83fc3e633c334fc5b44842d6590c68ee)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.787916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09a6c4-734d-4987-a587-6cbda98b7461 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.794047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 157/309] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:42 2022] GET /identity/v3/users/83fc3e633c334fc5b44842d6590c68ee => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:42.796216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:42.909578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c138ba-d30d-4d78-a3ff-ca66fcd82731 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:42.921471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea85e2-4b19-429d-aa49-c6db003f68e2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.921767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea85e2-4b19-429d-aa49-c6db003f68e2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.922010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea85e2-4b19-429d-aa49-c6db003f68e2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.923497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 158/310] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:42.928722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.929217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.929680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.946543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:42.948119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:42.951902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:42.952988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:42.952988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:42.953151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:42.953950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] RBAC: Adding query filter params (role.id=8c92d030e061456db1d51b8f27c13df7, user.id=83fc3e633c334fc5b44842d6590c68ee, scope.system=all) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:42.954260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:42.955763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:42.961638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 153/311] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 22:24:42 2022] GET /identity/v3/role_assignments?user.id=83fc3e633c334fc5b44842d6590c68ee&scope.system=all&role.id=8c92d030e061456db1d51b8f27c13df7 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:43.025631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 159/312] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:43.050038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:43.078818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:43.166413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212aa0d-94a0-479c-bfd1-d6f6c0878e50 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:43.202470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:43.203326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:43.203603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:43.203872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:43.214193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:43.221999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:43.223086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:43.224042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:43.227096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 154/313] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:43.229472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:43.256160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:43.329057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4daca1-9141-444b-aa31-81cebc094f06 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:43.363128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:43.363809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:43.364085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:43.364351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:43.365111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:43.365415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:43.366801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:43.381463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 160/314] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:43.382281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:43.469229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:43.487550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42cd4-b2d6-4c94-adae-6bd004987391 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:43.522431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:43.523351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:43.523628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:43.523898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] PATH_INFO: `/v3/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:43.525185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa622dfbc4a46bf834b7e2c3ca7a6b2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:43.526700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:43.533339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 155/315] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:43 2022] GET /identity/v3/users/dfa622dfbc4a46bf834b7e2c3ca7a6b2 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:43.534705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:43.615500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:43.638724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd331-c8c7-4ea2-b882-71f1a38c9077 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:43.671731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:43.672383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:43.672666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:43.672933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:43.739646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:43.741184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:43.819365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:43.847106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 161/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:43.849526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:43.953763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe93cce-b123-4970-895a-1541830db8f4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:43.988886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bac652-17bb-45f4-9882-f9a1b4a5814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:43.990132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac652-17bb-45f4-9882-f9a1b4a5814d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:43.990625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac652-17bb-45f4-9882-f9a1b4a5814d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:43.991119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bac652-17bb-45f4-9882-f9a1b4a5814d None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:43.992503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bac652-17bb-45f4-9882-f9a1b4a5814d None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:43.994133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bac652-17bb-45f4-9882-f9a1b4a5814d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:43.996391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 156/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:43 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:44.004363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:44.103018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c78f-d49e-4bcf-aceb-d2086d056d1d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:44.137368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:44.138036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.138344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.138615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.139616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] RBAC: Adding query filter params (role.id=8c92d030e061456db1d51b8f27c13df7, scope.project.id=55d608fc3e544ac08d522367867a17c0, user.id=dfa622dfbc4a46bf834b7e2c3ca7a6b2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:44.139929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:44.141374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5daec5f-5084-4360-a37f-25d4a03ec45f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:44.152097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 162/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:24:44 2022] GET /identity/v3/role_assignments?user.id=dfa622dfbc4a46bf834b7e2c3ca7a6b2&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=8c92d030e061456db1d51b8f27c13df7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:44.368442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c2b8-731e-43b1-b355-0d2e6f8ce259 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.369149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c2b8-731e-43b1-b355-0d2e6f8ce259 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.369634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0c2b8-731e-43b1-b355-0d2e6f8ce259 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.371273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 157/319] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:44.380687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.380687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.380687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.398533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:44.399751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:44.432541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:44.464412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 163/320] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:44.487208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c2b8-731e-43b1-b355-0d2e6f8ce259 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:44.509321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:44.586978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0c2b8-731e-43b1-b355-0d2e6f8ce259 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:44.620203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009b783-c219-4979-bde2-b6d5322de39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:44.620923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b783-c219-4979-bde2-b6d5322de39a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.621197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b783-c219-4979-bde2-b6d5322de39a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.621465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009b783-c219-4979-bde2-b6d5322de39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.631863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009b783-c219-4979-bde2-b6d5322de39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f009b783-c219-4979-bde2-b6d5322de39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:44.639645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:44.640503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:44.641328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 158/321] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:44.647998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:44.747661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499ae5c-8be7-4c5f-84c9-0e56c6d248b7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:44.770497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3a231-ab70-4b76-90eb-1d3accecb6b7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.770780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3a231-ab70-4b76-90eb-1d3accecb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.771100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3a231-ab70-4b76-90eb-1d3accecb6b7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.772487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 159/322] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:44.777669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.777953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.778222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.784529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:44.785205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.785478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.785765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.786494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:44.786795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:44.788234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:44.797041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 164/323] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:44.798232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:44.799630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:44.802277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:44.834012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:44.874642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 160/324] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:44.896254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:44.904087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d7186-ffa5-4d83-8e3a-a28ff02e6ad6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:44.908457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:44.942716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:44.943706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:44.943981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:44.944251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] PATH_INFO: `/v3/users/c4d8fe5a80134785a2610b12d47701ba` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:44.945683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d8fe5a80134785a2610b12d47701ba)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:44.946901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:44.948802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 165/325] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:44 2022] GET /identity/v3/users/c4d8fe5a80134785a2610b12d47701ba => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:44.954312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:44.998872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618dc71-4fc6-4671-a995-48717a1fcd00 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.034292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.035146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.035431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.035711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.036889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:45.038363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:45.040044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 161/326] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:45.045949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:45.058012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:45.061323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c02ff-aca8-4089-8596-ce357a465f43 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.097998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.098664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.099111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.099267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.100092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] RBAC: Adding query filter params (role.id=a7d68a2ab9454e02b30ff8582267dd82, user.id=c4d8fe5a80134785a2610b12d47701ba, scope.system=all) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:45.100406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:45.101867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba5729-876c-4082-b3e6-e427b1eda541 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:45.123033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 166/327] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 22:24:44 2022] GET /identity/v3/role_assignments?user.id=c4d8fe5a80134785a2610b12d47701ba&scope.system=all&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:45.142369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:45.167081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a265573-e149-46f7-93de-ef61f6eec3a2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.170894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399a15-2638-4bfe-935e-84f9cb308db6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.171297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399a15-2638-4bfe-935e-84f9cb308db6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.171492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399a15-2638-4bfe-935e-84f9cb308db6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.173165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 167/328] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:45.178773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.179095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.179376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.197758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:45.199063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:45.211529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.212331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.212522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.212850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] PATH_INFO: `/v3/groups` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.213542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:45.215065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:45.243028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 162/329] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jul 21 22:24:45 2022] POST /identity/v3/groups => generated 226 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:24:45.284209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 168/330] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:45.307187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:45.426797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0cf97-0ea5-4234-9f8a-63af904eb36d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.460312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.461124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.461399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.461674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.469093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:45.473693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:45.482730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:45.483706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:45.484471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:45.487140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 163/331] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:45.490069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:45.583217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:45.597588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb52d7b-3ba5-4062-a51a-f5e2611a935f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.632268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.632952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.633230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.633499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.634272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:45.634575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:45.636021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:45.645848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 169/332] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:45.651737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:45.755958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8517c8-c257-43ca-94ff-704180b00e3b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.793199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba1329-4b48-41e7-bcf1-d847755797c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.794382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba1329-4b48-41e7-bcf1-d847755797c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.794705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba1329-4b48-41e7-bcf1-d847755797c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.794986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba1329-4b48-41e7-bcf1-d847755797c0 None admin] PATH_INFO: `/v3/users/83fc3e633c334fc5b44842d6590c68ee` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.796240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba1329-4b48-41e7-bcf1-d847755797c0 None admin] RBAC: Authorizing `identity:get_user(user_id=83fc3e633c334fc5b44842d6590c68ee)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:45.797710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba1329-4b48-41e7-bcf1-d847755797c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:45.799561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 164/333] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:45 2022] GET /identity/v3/users/83fc3e633c334fc5b44842d6590c68ee => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:45.805089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:45.910849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb318b3-fdb2-4af6-93df-138ee76795ce None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:45.953893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577fcb2-a085-4616-b62f-56cb9315820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:45.955075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577fcb2-a085-4616-b62f-56cb9315820f None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:45.955491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577fcb2-a085-4616-b62f-56cb9315820f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:45.955897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577fcb2-a085-4616-b62f-56cb9315820f None admin] PATH_INFO: `/v3/system/users/83fc3e633c334fc5b44842d6590c68ee/roles/8c92d030e061456db1d51b8f27c13df7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:45.957521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577fcb2-a085-4616-b62f-56cb9315820f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=83fc3e633c334fc5b44842d6590c68ee, role_id=8c92d030e061456db1d51b8f27c13df7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:45.959067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577fcb2-a085-4616-b62f-56cb9315820f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:45.972310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 170/334] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jul 21 22:24:45 2022] PUT /identity/v3/system/users/83fc3e633c334fc5b44842d6590c68ee/roles/8c92d030e061456db1d51b8f27c13df7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:47.491665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb696-523a-486c-834f-9e0355c87cd9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:47.492180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb696-523a-486c-834f-9e0355c87cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:47.492285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb696-523a-486c-834f-9e0355c87cd9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:47.493858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 165/335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:47.499422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154331-2363-4f94-829a-645cbb0026cb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:47.499835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154331-2363-4f94-829a-645cbb0026cb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:47.500000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154331-2363-4f94-829a-645cbb0026cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:47.524034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dc154331-2363-4f94-829a-645cbb0026cb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:47.525251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dc154331-2363-4f94-829a-645cbb0026cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:47.535969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:47.608185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 171/336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:47.643717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb696-523a-486c-834f-9e0355c87cd9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:47.727370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:47.774644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb696-523a-486c-834f-9e0355c87cd9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:47.814653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c215b9-16c0-4e18-92b3-db2672d02de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:47.815492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c215b9-16c0-4e18-92b3-db2672d02de0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:47.815771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c215b9-16c0-4e18-92b3-db2672d02de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:47.816042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c215b9-16c0-4e18-92b3-db2672d02de0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:47.835338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c215b9-16c0-4e18-92b3-db2672d02de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:47.836717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185445-ec1f-4ccd-862c-0f8c2cfd8431 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:47.837202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185445-ec1f-4ccd-862c-0f8c2cfd8431 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:47.837669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27185445-ec1f-4ccd-862c-0f8c2cfd8431 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-57c215b9-16c0-4e18-92b3-db2672d02de0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:47.843698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:47.844579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:47.845779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 166/338] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:47.846934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 172/338] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:47.850593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:47.850840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185445-ec1f-4ccd-862c-0f8c2cfd8431 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:47.850937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:47.851181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:47.884080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:47.885298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:47.979533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27185445-ec1f-4ccd-862c-0f8c2cfd8431 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.018096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.018797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.019096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.019370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.020138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:48.020449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:48.021876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:48.036800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 173/339] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:48.037849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.050467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:48.120631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 167/340] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:48.143870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0701f-cb2a-4adc-9961-433c2dc8ab98 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.153947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.183082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.183793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.184073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.184544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.252332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:48.262957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:48.264455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:48.275367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:48.320959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6627e0-fff2-482c-8993-83f8a0d138ef None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.374193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 174/341] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:48.381028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.382095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.383201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.385767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.387980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.413344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:48.428466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:48.429373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:48.430122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 168/342] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:48.435830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.526985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f15769-541f-4367-b5e2-c24648e261a5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.536662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:48.567454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.568682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.569174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.569628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.571023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:48.572850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:48.575157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 175/343] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:48.584003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.701989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec876-bf24-418b-a8b4-d94284bbe310 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.711042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb8cd8-24de-45e9-bbd4-a51c6b2fc21b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.729139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:48.757866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.759154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.759725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.760271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.763739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.764449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.764970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.764970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.765755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:48.766063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:48.771126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:48.772666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:48.774323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:48.776294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 176/344] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:48.782753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.784662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 169/345] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:48.792005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:48.835069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:48.903162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13d8bc-881f-4687-9f41-199f3c8aaf59 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.930920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f946a5-3235-498b-aa74-c0ed0f0ced17 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:48.938570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.939592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.940132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.940591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.941660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:48.942158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:48.943837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bc2d-4c98-4b3e-9a8a-e7319235bf03 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:48.950515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 177/346] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:48.952168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485164c-49ad-49eb-858a-71e1ba70e66f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.952737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485164c-49ad-49eb-858a-71e1ba70e66f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.953262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485164c-49ad-49eb-858a-71e1ba70e66f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.954913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 178/347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:48.960839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.961452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.961916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:48.981712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:48.983686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:48.995861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:48.996547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:48.996827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:48.997096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.061518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 179/348] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:49.075648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:49.089343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:49.116966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:49.118796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:49.153774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:49.310316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 170/349] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:49.319101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c15c7-1580-4779-ad4f-476a5fcecf04 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:49.324656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:49.403922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:49.404824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.405105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.405379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.425677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:49.433683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:49.434595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:49.435968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:49.438114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 180/350] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:24:49.440962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:49.461377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:49.488600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627673-d6e0-4892-b9b8-7f353edaf80e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:49.562495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a200530-b1c1-4f5d-90f7-d9a69bcdeee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:49.563548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a200530-b1c1-4f5d-90f7-d9a69bcdeee2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.563826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a200530-b1c1-4f5d-90f7-d9a69bcdeee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.564097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a200530-b1c1-4f5d-90f7-d9a69bcdeee2 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.565429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a200530-b1c1-4f5d-90f7-d9a69bcdeee2 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:49.566880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a200530-b1c1-4f5d-90f7-d9a69bcdeee2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:49.568935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 171/351] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:49 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:49.570262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc1d9-b10c-48e6-bd92-86aae15e839c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.570490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc1d9-b10c-48e6-bd92-86aae15e839c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.570760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdc1d9-b10c-48e6-bd92-86aae15e839c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.572383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 172/352] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:49.573534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095bfa-92a9-40d9-a3b7-67819ed691fe None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.573808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095bfa-92a9-40d9-a3b7-67819ed691fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.574080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095bfa-92a9-40d9-a3b7-67819ed691fe None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.579541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 173/353] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:49.580329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31095bfa-92a9-40d9-a3b7-67819ed691fe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:49.588063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:49.605187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287adfc-ff7f-4602-8575-4d045292715c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:49.651377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dae84-7277-4667-b969-9607832417ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:49.652072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dae84-7277-4667-b969-9607832417ba None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.652358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dae84-7277-4667-b969-9607832417ba None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.652635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dae84-7277-4667-b969-9607832417ba None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.653404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dae84-7277-4667-b969-9607832417ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:49.654002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dae84-7277-4667-b969-9607832417ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:49.655692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dae84-7277-4667-b969-9607832417ba None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:49.669603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 181/354] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:49.671017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.671315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.671593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.692928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:49.694535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:49.714904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31095bfa-92a9-40d9-a3b7-67819ed691fe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:49.755870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bbd4d-85f2-47a1-891a-2f8dbb6cc3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:49.756766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bbd4d-85f2-47a1-891a-2f8dbb6cc3ed None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.757085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bbd4d-85f2-47a1-891a-2f8dbb6cc3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.757379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bbd4d-85f2-47a1-891a-2f8dbb6cc3ed None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.759366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bbd4d-85f2-47a1-891a-2f8dbb6cc3ed None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:49.760819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bbd4d-85f2-47a1-891a-2f8dbb6cc3ed None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:49.764829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 174/355] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:49 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:49.766158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.766442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.766713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:49.784244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 182/356] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:49.785129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:49.800368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:49.801627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:49.816995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:49.890315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:49.891330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 175/357] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:49.892233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:49.914608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cc24-39e9-4e42-b43c-17691379b5a3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:49.955787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:49.956479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:49.957003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:49.957287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.012705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925b0a-f8b0-4329-9688-2b48cfccdc76 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.042677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.044343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.056536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.057217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.057722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.057722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.058586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:50.058892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.060405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7f229-21c6-4d02-b1fb-33b244b45b2b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.069805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 176/358] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:49 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:50.070905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdd90-c778-43ce-8367-f84f0c933e3b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.071234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdd90-c778-43ce-8367-f84f0c933e3b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.071510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fdd90-c778-43ce-8367-f84f0c933e3b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.075831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 177/359] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:50.076547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fdd90-c778-43ce-8367-f84f0c933e3b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.093795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.168406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.191474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 183/360] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:50.192654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.221211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fdd90-c778-43ce-8367-f84f0c933e3b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.269743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef62-b991-4f9f-b7a3-7c15f898ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.270583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef62-b991-4f9f-b7a3-7c15f898ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.270849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef62-b991-4f9f-b7a3-7c15f898ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.271467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef62-b991-4f9f-b7a3-7c15f898ebd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.285533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ef62-b991-4f9f-b7a3-7c15f898ebd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-fa79ef62-b991-4f9f-b7a3-7c15f898ebd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:50.293502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:50.294382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:24:50.295246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:50.300822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 178/361] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:50.302221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.302509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.302787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.327396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:50.329207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:50.329883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8ebc-211c-4d75-846b-456af2737a38 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.373369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.373369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.373369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.373369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.390700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:50.401671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:50.402544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:50.403499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:50.404808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 184/362] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:50.407152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.424815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.434185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 179/363] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:50.435086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.487378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.547499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe21e64-e89a-4104-9293-49107da9875e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.553613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b561-58d8-4845-a06c-80c2d01530b2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.588080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.588938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.589217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.589525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.590330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:50.590641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.590733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.591569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.591892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.592125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.592217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.593371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.594837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.596936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 185/364] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:50.597741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.601705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 180/365] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:50.602648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.672200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.710706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea070-de8e-405a-907e-57070f3e79d5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.714814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237601-432d-44e3-b76b-b8a0943ddc0f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.726884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.754567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.755140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.755653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.755936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.756212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.756507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.756944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.757046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:50.757266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.757560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.758943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.770042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 186/366] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:50.770607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:50.770710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:50.779073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:50.779993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:50.780748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:50.783145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 181/367] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:50.784062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.878481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d35d-afa3-4f4e-9b03-82768335d4f4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.904661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9952223-e308-49d3-88bc-b11dd009cbf5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:50.915831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.916973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.917388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.917789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] PATH_INFO: `/v3/users/83fc3e633c334fc5b44842d6590c68ee` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.919170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] RBAC: Authorizing `identity:get_user(user_id=83fc3e633c334fc5b44842d6590c68ee)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.920795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.922615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 187/368] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/users/83fc3e633c334fc5b44842d6590c68ee => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:50.923529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.926120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:50.942970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:50.943814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:50.944102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:50.944379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:50.945826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:50.947753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:50.954161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 182/369] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:50.954161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:50.980205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.045730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d8ca4-bf8c-4fa9-8536-c713060e3a31 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.083051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.083696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28564e3-9e16-47b4-9bd5-74816d0a688c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.084261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.084770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.085224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.126941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.127660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.127944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.128222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.128983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:51.129292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.132060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.142079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 183/370] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:51.147113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:51.183815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.186249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.211048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.234016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.269647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7a37-d5e7-41c4-ae0c-f0aa9eaf12df None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.306081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e69c3-d560-484d-a893-3790e664907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.306423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e69c3-d560-484d-a893-3790e664907a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.306683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e69c3-d560-484d-a893-3790e664907a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.307130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e69c3-d560-484d-a893-3790e664907a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.307975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e69c3-d560-484d-a893-3790e664907a None admin] RBAC: Adding query filter params (role.id=8c92d030e061456db1d51b8f27c13df7, user.id=83fc3e633c334fc5b44842d6590c68ee, scope.system=all) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:51.308288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e69c3-d560-484d-a893-3790e664907a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.310207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e69c3-d560-484d-a893-3790e664907a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.313798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 188/371] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:51.314850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:51.332071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 184/372] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/role_assignments?user.id=83fc3e633c334fc5b44842d6590c68ee&scope.system=all&role.id=8c92d030e061456db1d51b8f27c13df7 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:51.333262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e69c3-d560-484d-a893-3790e664907a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:51.479022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e69c3-d560-484d-a893-3790e664907a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.490717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.493198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f774e-213d-4cd3-b84e-523201ec8a6b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.524520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba46ea-36dd-4385-8d58-437f5e3e9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.525586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba46ea-36dd-4385-8d58-437f5e3e9c09 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.526162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba46ea-36dd-4385-8d58-437f5e3e9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.526623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba46ea-36dd-4385-8d58-437f5e3e9c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.551249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.551902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.552183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.552457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.553631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=55d608fc3e544ac08d522367867a17c0) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:51.553941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.555464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.562160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 189/373] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:51.567014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:51.581006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.646808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba46ea-36dd-4385-8d58-437f5e3e9c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.648547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba46ea-36dd-4385-8d58-437f5e3e9c09 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.742040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1a17-5909-466a-ad49-36ccfc3cad4d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.765301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 185/374] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:51.766719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62ba8-1297-436f-9f49-7703725cb5db None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.767028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62ba8-1297-436f-9f49-7703725cb5db None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.767323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62ba8-1297-436f-9f49-7703725cb5db None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.774124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 186/375] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:51.775025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62ba8-1297-436f-9f49-7703725cb5db None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:51.789910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.794484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9163-11a0-4e41-b130-9706a5eca5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.795443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9163-11a0-4e41-b130-9706a5eca5fc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.796034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9163-11a0-4e41-b130-9706a5eca5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.796034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9163-11a0-4e41-b130-9706a5eca5fc None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.797665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb9163-11a0-4e41-b130-9706a5eca5fc None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.798790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb9163-11a0-4e41-b130-9706a5eca5fc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.800763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 190/376] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:51.801723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.802016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.802294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.827812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:51.829005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:51.923810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62ba8-1297-436f-9f49-7703725cb5db None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:51.928097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 191/377] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:51.928766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:51.931976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:51.962482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:51.963535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:51.963893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:51.964087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] PATH_INFO: `/v3/projects/68110cc172da4f7f98143d7196095a84` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:51.965316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] RBAC: Authorizing `identity:get_project(project_id=68110cc172da4f7f98143d7196095a84)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:51.966793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:51.968818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 187/378] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/projects/68110cc172da4f7f98143d7196095a84 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:51.969425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.040941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ce9c1-062b-4d46-9de6-8e12ea458758 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.051991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:52.076364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086bc4-9a10-4bdd-baec-a0c8631849b0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.079446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.080341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.080617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.080883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.083063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:52.084697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:52.086770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 192/379] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:52.087454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.122108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.122940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.123286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.123693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.137685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:52.148964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:52.149875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:52.150884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 188/380] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:52.152194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.173824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:52.209671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794faa-bd2e-4917-b1b7-d853b0a93be4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.253666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.254544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.254820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.255137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] PATH_INFO: `/v3/groups/9d51f704dec642f19b0db3424aa2a661` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.260784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] RBAC: Authorizing `identity:get_group(group_id=9d51f704dec642f19b0db3424aa2a661)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:52.262383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:52.264576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 193/381] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/groups/9d51f704dec642f19b0db3424aa2a661 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:52.265179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.290107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24b83-4852-45d4-b1ae-dacfe027caa2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.334628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.336071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.336503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.337223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.338615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=55d608fc3e544ac08d522367867a17c0) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:52.339522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:52.341421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:52.346093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:52.349597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 189/382] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:52.350579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.422832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc0ea7-457d-46eb-b966-3e37c42facc3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.511782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.512479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.512761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.513033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.513852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:52.514166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:52.515617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:52.524681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:52.533613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea1a0c-6440-4f8d-826d-f441832e5eff None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.538458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 194/383] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:52.544355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.588282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.588915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.589194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.589467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.590574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] RBAC: Adding query filter params (group.id=9d51f704dec642f19b0db3424aa2a661, role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=68110cc172da4f7f98143d7196095a84) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:52.590892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:52.593514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ed0bd-7b6f-4111-980e-390ebf64c450 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:52.600970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 190/384] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/role_assignments?group.id=9d51f704dec642f19b0db3424aa2a661&scope.project.id=68110cc172da4f7f98143d7196095a84&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:52.609298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8fd7-b7d4-4f15-8f1d-8a6d7f379d43 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.609935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8fd7-b7d4-4f15-8f1d-8a6d7f379d43 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.610410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8fd7-b7d4-4f15-8f1d-8a6d7f379d43 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.612259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 191/385] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:52.618580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.619460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.619941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.645522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:52.647231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:52.713765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44245c3a-6079-45eb-93d3-4b562e924a25 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.755694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.756593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.756871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.757142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:52.758422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:52.760014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:52.762132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 195/386] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:52.767741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.809394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:52.814887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 192/387] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:52.840144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:52.869611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:52.940012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad856de-d7ee-44ba-ae97-ad7ebc871103 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:52.994379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:52.995307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:52.995589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:52.995859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.003782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:53.005319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:53.007149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 196/388] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:53.013318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:53.060938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ef5ee-cab8-4e74-af85-dcd067c779cc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:53.153659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:53.154441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:53.154860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:53.155170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.174310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c223c3d-0439-4a36-8696-4ccb7d0bd17f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:53.183051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:53.192553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:53.193484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:53.194333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 193/389] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:53.203064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:53.267793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:53.292281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:53.293665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:53.294154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:53.294630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/groups/2864a2b3447347bb96c53a5465bcff04/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.300360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] RBAC: Authorizing `identity:create_grant(project_id=25ef1dfe56b347a2b0d8603d7447b428, group_id=2864a2b3447347bb96c53a5465bcff04, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:53.302103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:53.307305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:53.319698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1541b-115c-4d3b-a97c-4f8fdab04f2d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:53.339752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 197/390] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 22:24:53 2022] PUT /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/groups/2864a2b3447347bb96c53a5465bcff04/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:53.360578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:53.361287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:53.361568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:53.361843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.362624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:53.363015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:53.364537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:53.380224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 194/391] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:53.388238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:53.548049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232e3e-6c0f-4671-b476-4e028b533fab None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:53.603223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:53.604595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:53.605073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:53.605548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.607691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:53.609389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:53.611649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 198/392] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:53 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:53.616961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:53.740832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c023c-ca0f-4afa-bad0-15ca1de0d0ad None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:53.757985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:53.783142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ba9e6-ac51-458e-ad1f-bfca51318cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:53.784037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ba9e6-ac51-458e-ad1f-bfca51318cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:53.784316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ba9e6-ac51-458e-ad1f-bfca51318cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:53.784591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ba9e6-ac51-458e-ad1f-bfca51318cd5 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.785796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ba9e6-ac51-458e-ad1f-bfca51318cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:53.787278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ba9e6-ac51-458e-ad1f-bfca51318cd5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:53.789301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 195/393] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:53 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:53.795259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:53.903172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:53.955529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c104ae-86ad-446e-8ba6-efb3ee7fee98 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:53.995387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ccc2c-2156-4992-97a0-a246e1f0b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:53.996294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ccc2c-2156-4992-97a0-a246e1f0b40b None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:53.996577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ccc2c-2156-4992-97a0-a246e1f0b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:53.996848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ccc2c-2156-4992-97a0-a246e1f0b40b None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/groups/2864a2b3447347bb96c53a5465bcff04/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:53.999252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ccc2c-2156-4992-97a0-a246e1f0b40b None admin] RBAC: Authorizing `identity:create_grant(project_id=25ef1dfe56b347a2b0d8603d7447b428, group_id=2864a2b3447347bb96c53a5465bcff04, role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:54.000692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ccc2c-2156-4992-97a0-a246e1f0b40b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:54.022878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 199/394] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 22:24:53 2022] PUT /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428/groups/2864a2b3447347bb96c53a5465bcff04/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:54.216334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af757c-9a22-4656-9e06-e8ddce1868ff None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:54.216874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af757c-9a22-4656-9e06-e8ddce1868ff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:54.216874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af757c-9a22-4656-9e06-e8ddce1868ff None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:54.218656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 196/395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:54.224126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:54.224396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:54.224675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:54.245240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:54.246451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:54.323667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 200/396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:54.345808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af757c-9a22-4656-9e06-e8ddce1868ff None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:54.464651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af757c-9a22-4656-9e06-e8ddce1868ff None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:54.506533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:54.507292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:54.507567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:54.507836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:54.527923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:54.536074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:54.538109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:54.540061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 197/397] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:54.547046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:54.625542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:54.678773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017b41b-41c0-4ea6-b8db-0debb61a4482 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:54.720922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:54.721614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:54.721902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:54.722165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:54.722936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:54.723264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:54.724665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:54.738103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 201/398] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:54.740092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:54.829342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:54.911756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d281a8-919e-4898-a0b0-63a632d0ec4e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:54.959714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afba1e-e576-4f05-babe-8e54c6600ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:54.960606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afba1e-e576-4f05-babe-8e54c6600ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:54.960884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afba1e-e576-4f05-babe-8e54c6600ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:54.961150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afba1e-e576-4f05-babe-8e54c6600ab7 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:54.962345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afba1e-e576-4f05-babe-8e54c6600ab7 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:54.963838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afba1e-e576-4f05-babe-8e54c6600ab7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:54.965789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 198/399] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:54 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:54.971228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.077173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf162d-728b-4e82-a036-3d03a1a38c78 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.077527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf162d-728b-4e82-a036-3d03a1a38c78 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.077705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf162d-728b-4e82-a036-3d03a1a38c78 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.079586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 199/400] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:55.085142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d502a-ac49-4619-b7b5-22065ce2a8f0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.085142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d502a-ac49-4619-b7b5-22065ce2a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.085142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d502a-ac49-4619-b7b5-22065ce2a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.121102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-329d502a-ac49-4619-b7b5-22065ce2a8f0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:55.126008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-329d502a-ac49-4619-b7b5-22065ce2a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:55.144551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63952b5b-d22a-4763-a47c-66ac1e071d6f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:55.163352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:55.183167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:55.184544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.184959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.185370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.186779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:55.188490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:55.190980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 202/401] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:54 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:55.199452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.296563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 200/402] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:55.298514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704bc47-575b-4f09-964b-46996924828b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.298974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704bc47-575b-4f09-964b-46996924828b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.299493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704bc47-575b-4f09-964b-46996924828b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.301044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 201/403] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:55.306602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.307197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.307633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.315361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42b80-2b84-493f-96ef-693c013dba5e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:55.337959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:55.339683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:55.350926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:55.352148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.352610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.353063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0/groups/2864a2b3447347bb96c53a5465bcff04/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.355331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] RBAC: Authorizing `identity:create_grant(project_id=55d608fc3e544ac08d522367867a17c0, group_id=2864a2b3447347bb96c53a5465bcff04, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:55.357049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:55.378635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 203/404] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 22:24:55 2022] PUT /identity/v3/projects/55d608fc3e544ac08d522367867a17c0/groups/2864a2b3447347bb96c53a5465bcff04/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:55.379912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.390411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:55.459554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 202/405] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:55.471380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:55.494633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.577505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193a562-01bd-498d-b7ee-065937383b5d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:55.625157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:55.625575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.625850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.626119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.638607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:55.647223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:55.648189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:55.648962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:55.653339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:55.654727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.671931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a48a4-ff3d-4acf-9907-0cad8a58a942 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:55.721287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:55.722579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.723280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.724140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.752260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:55.763537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:55.764499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:55.765285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:55.767700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:24:55.770574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.778549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629088-65de-471d-beaa-dcaea24f195d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:55.781399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:55.823434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:55.823434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.823434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.823434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.823857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:55.823857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:55.828260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:55.838060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:55.853365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:55.858941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:55.919120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a506b8-b30c-4393-8b13-85a6a5269a5e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:55.961948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:55.964104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:55.966122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:55.966618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:55.967641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:55.969086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:55.975533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:55.989605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 204/409] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:55.995172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.034891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a60360-7816-4f6f-9874-1ad9ccd712c7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.086295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f4031-9348-493b-b4cb-04bb7d3d9495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.087686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4031-9348-493b-b4cb-04bb7d3d9495 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.087964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4031-9348-493b-b4cb-04bb7d3d9495 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.088235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f4031-9348-493b-b4cb-04bb7d3d9495 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.089715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4031-9348-493b-b4cb-04bb7d3d9495 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.091990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f4031-9348-493b-b4cb-04bb7d3d9495 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.099078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 206/410] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:55 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:56.100811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38beed-21a6-4a11-bb26-a729913c79fd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.101094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38beed-21a6-4a11-bb26-a729913c79fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.101368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38beed-21a6-4a11-bb26-a729913c79fd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.102881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 207/411] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:56.107557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38beed-21a6-4a11-bb26-a729913c79fd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.134686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:56.143526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:56.144371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4676370-70d1-4e02-a04c-2824086211da None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.186772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cafd69-1146-447a-bf67-44c16418f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.187620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cafd69-1146-447a-bf67-44c16418f53e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.187887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cafd69-1146-447a-bf67-44c16418f53e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.188154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cafd69-1146-447a-bf67-44c16418f53e None admin] PATH_INFO: `/v3/groups/9d51f704dec642f19b0db3424aa2a661` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.189928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cafd69-1146-447a-bf67-44c16418f53e None admin] RBAC: Authorizing `identity:get_group(group_id=9d51f704dec642f19b0db3424aa2a661)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.191414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cafd69-1146-447a-bf67-44c16418f53e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.193401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:55 2022] GET /identity/v3/groups/9d51f704dec642f19b0db3424aa2a661 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:56.194676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.194926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.195276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.211933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:56.213171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:56.246101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38beed-21a6-4a11-bb26-a729913c79fd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.291015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 206/413] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:56.291015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.305796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.306730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.307018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.307307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.309699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.312450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.314341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 208/414] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:56 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:56.316688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.399976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:56.410953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce012e-ffb5-4c07-9ebe-2c418c7c12e6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.427121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:56.430866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c10a-3e87-41a2-b030-a25c32e7472f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.446750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.447992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.448480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.448947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] PATH_INFO: `/v3/projects/68110cc172da4f7f98143d7196095a84` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.450446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=68110cc172da4f7f98143d7196095a84)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.452213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.454413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 207/415] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:56 2022] GET /identity/v3/projects/68110cc172da4f7f98143d7196095a84 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:56.455461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.468266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.469122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.469402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.469673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.480863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:56.489510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:56.490368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:56.491173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 209/416] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:56.491823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.561043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e4b8-f634-4723-a04f-06fd8fcd1cc1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.595178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.596061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.596463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.596735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0/groups/2864a2b3447347bb96c53a5465bcff04/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.598693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05f26-d32a-45bb-b9ae-813f07990e15 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.598928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] RBAC: Authorizing `identity:create_grant(project_id=55d608fc3e544ac08d522367867a17c0, group_id=2864a2b3447347bb96c53a5465bcff04, role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.600397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.614629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 22:24:56 2022] PUT /identity/v3/projects/55d608fc3e544ac08d522367867a17c0/groups/2864a2b3447347bb96c53a5465bcff04/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:56.615680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.646494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d4d06-7721-4474-92cf-f00cc8dbdd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.647453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4d06-7721-4474-92cf-f00cc8dbdd5b None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.647729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4d06-7721-4474-92cf-f00cc8dbdd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.648002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d4d06-7721-4474-92cf-f00cc8dbdd5b None admin] PATH_INFO: `/v3/projects/68110cc172da4f7f98143d7196095a84/groups/9d51f704dec642f19b0db3424aa2a661/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.650255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4d06-7721-4474-92cf-f00cc8dbdd5b None admin] RBAC: Authorizing `identity:create_grant(project_id=68110cc172da4f7f98143d7196095a84, group_id=9d51f704dec642f19b0db3424aa2a661, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.651805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d4d06-7721-4474-92cf-f00cc8dbdd5b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.657551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:56.673993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 210/418] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 22:24:56 2022] PUT /identity/v3/projects/68110cc172da4f7f98143d7196095a84/groups/9d51f704dec642f19b0db3424aa2a661/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:24:56.675844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211d6fd-e0c5-4786-a19f-cc154faf9c11 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.676277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211d6fd-e0c5-4786-a19f-cc154faf9c11 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.676701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211d6fd-e0c5-4786-a19f-cc154faf9c11 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.678772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 211/419] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:56.692554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.693131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.693625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.727386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:56.730347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:56.774352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:56.808366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016221-3dcb-4773-b460-cbf97c83f139 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:56.857752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 212/420] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:56.865598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:56.866297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:56.866578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:56.866850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:56.867653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:56.867961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:56.869351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:56.880563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 209/421] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:56.883923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.887803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:56.996509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.010253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c7538-d62e-43fa-84aa-8af10c04f919 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.017278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3faaa-54c6-4947-8c6e-99bb3ef635ec None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.052683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.053577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.054062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.054550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.067535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.069056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.069545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.070020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.090483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:57.105905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:57.106798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:57.107603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:57.110763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 213/422] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:57.120177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:57.149778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.205593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:57.207112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:57.321298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3b8f-1f23-47d8-8049-fc39689c004f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.338346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.370056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 210/423] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:57.376493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:57.390670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.395012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.395012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.395012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.395012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:57.395012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:57.395012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:57.405237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 214/424] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:57.411389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:57.534075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.568449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa5f4-0dd9-494d-b38d-58dd5174ccef None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.594833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a70f46-e31f-41fb-9934-6a9a510add26 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.603464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.604419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.604701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.604971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.606182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:57.607687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:57.609853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 211/425] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:57 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:57.615352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:57.663432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8d5a-1f2a-4114-b76a-cbfbbede3e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.664329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8d5a-1f2a-4114-b76a-cbfbbede3e48 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.664615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8d5a-1f2a-4114-b76a-cbfbbede3e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.664883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8d5a-1f2a-4114-b76a-cbfbbede3e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.671423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.729264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453fbb-a8a3-42ff-a64d-ca50f41ebc5b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.770687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.771790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.773192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.773192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.774212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:57.775468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:57.777454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 212/426] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:57 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:57.785648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:57.815268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d8d5a-1f2a-4114-b76a-cbfbbede3e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:57.818793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d8d5a-1f2a-4114-b76a-cbfbbede3e48 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:57.944452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17223b68-f30c-4b03-9c37-3405034a3749 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:57.951475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.968357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:57.978883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 215/427] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:57.980646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f204fa-f350-4d3f-b3a8-9105b6364671 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.981001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f204fa-f350-4d3f-b3a8-9105b6364671 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.981342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f204fa-f350-4d3f-b3a8-9105b6364671 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.983150 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 216/428] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:57.984748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f204fa-f350-4d3f-b3a8-9105b6364671 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:57.990703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:57.991602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:57.992042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:57.992467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:57.993444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:57.993912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:57.996048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033442-86c9-493f-b094-7c532fc04b71 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:58.005096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:57 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:58.006502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.006921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.007396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.030245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:58.036695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:58.103833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f204fa-f350-4d3f-b3a8-9105b6364671 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:58.141581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:58.142528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.143061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.143340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] PATH_INFO: `/v3/projects/25ef1dfe56b347a2b0d8603d7447b428` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.144656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] RBAC: Authorizing `identity:get_project(project_id=25ef1dfe56b347a2b0d8603d7447b428)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:58.146296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:58.148490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 217/430] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:57 2022] GET /identity/v3/projects/25ef1dfe56b347a2b0d8603d7447b428 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:58.158114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:58.164876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 214/431] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:58.224195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:58.225140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:58.301027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466412a0-03c6-43d9-8337-8302d7e75d50 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:58.345814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:58.347145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.347456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.347731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.348983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:58.350422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:58.353030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 218/432] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:58 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:58.363969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:58.371630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45710f-5ef1-44a6-8033-4e60d5043837 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:58.386538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:58.421386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:58.422223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.422503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.422775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.439229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:58.448589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:58.449589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:24:58.450598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 215/433] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:58.461372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:58.505508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e2b52-9bff-4b8e-b4d2-0078f85452c2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:58.518727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:58.556544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:58.557221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.557578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.557858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.558713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=25ef1dfe56b347a2b0d8603d7447b428) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:58.560485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:58.561625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:58.569727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 219/434] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:58 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=25ef1dfe56b347a2b0d8603d7447b428&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:58.604973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad217f-a09d-446d-b470-f2d1bf5e256b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:58.645657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:58.646721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.647249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.647733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.648685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:58.649202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:58.650795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77f26b-b6e3-4a20-861c-8acec3ea2f1d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:58.661873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 216/435] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:58.667290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:58.786485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4964b-e732-4bb2-ac3a-1248f1e89eb2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:58.822940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:58.823972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.824446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.824946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.871965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:58.897401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:58.899244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:58.983693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24282d7-05cf-4a08-9b36-d6c182e3c2ce None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.984322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24282d7-05cf-4a08-9b36-d6c182e3c2ce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.984822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24282d7-05cf-4a08-9b36-d6c182e3c2ce None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:58.989139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 217/436] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:24:58.993570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a716574-ee16-4a57-960b-76b0bc4d3291 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:58.994084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a716574-ee16-4a57-960b-76b0bc4d3291 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:58.994558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a716574-ee16-4a57-960b-76b0bc4d3291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.002678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 220/437] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:59.010731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.017268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0a716574-ee16-4a57-960b-76b0bc4d3291 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:59.018458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0a716574-ee16-4a57-960b-76b0bc4d3291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:59.050775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.100486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 218/438] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:59.100891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.101883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9406b-0dbb-4ac4-8722-496589ded577 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.102171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9406b-0dbb-4ac4-8722-496589ded577 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.103057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9406b-0dbb-4ac4-8722-496589ded577 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.107030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 219/439] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:59.111904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.112250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.112583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.133837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:59.134950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:59.137727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6986e4-24a8-4c4a-b21d-70e2597e33c3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.178172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.179076 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.179367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.179627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.180806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.182318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:59.184249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 221/440] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:24:59.184783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.214059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 220/441] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:59.214892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.290274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53011e5-7894-4c1f-b84e-02d9bfc79b7a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.306893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.314010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b140e6-4be6-47e4-b381-c83c05fff146 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.322857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.323736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.324017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.324360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.331997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.335305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:59.344067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:59.345086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:59.345943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 222/442] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:59.346694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.352210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.353086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.353364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.353636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.354961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.356456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:59.358151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 221/443] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:59.358906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.451840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbc8cd-be7d-47f5-a566-646b9d5e7a8a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.463809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72983e-71b5-40c7-84cf-045a29c942b2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.486488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.487330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.487609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.487877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.499610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:24:59.500750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.501424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.501701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.501971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.502725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:59.503023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.504436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:24:59.507312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:24:59.508301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:24:59.509306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 223/444] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:24:59.510917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.513090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 222/445] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:59.518403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.544450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.573586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.614039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3173d-a1c4-4c62-a5bc-2f6bc54e6252 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.619541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04643-c62a-46c2-882c-cac50c5e0900 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.648053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.648695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.648980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.649256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.650092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a7d68a2ab9454e02b30ff8582267dd82, scope.project.id=55d608fc3e544ac08d522367867a17c0) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:59.650399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.651898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:59.654033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.654705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.655056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.655333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.656070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:24:59.656374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.658084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:59.658175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 224/446] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a7d68a2ab9454e02b30ff8582267dd82 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:59.658880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.674586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 223/447] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:24:59.679815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:59.777964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f68ce8-9e4e-4538-95e5-a5caee1acc1b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.778248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.801320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534bb6-1211-4e90-a573-4346ea3eec25 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:59.805547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:59.816878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.817565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.817848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.818113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.842508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:59.843093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:59.843391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:59.843664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:59.896227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.897715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:59.923453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:59.924949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.017030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 225/448] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:00.021831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:00.026699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.042941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 224/449] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:00.046134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.049148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:00.118346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1785b7-c82c-4548-92dc-7843c7df450b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:00.143844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebd46d-ed02-42e8-966b-4205625f5f57 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:00.150951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:00.151847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:00.152127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:00.152397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] PATH_INFO: `/v3/projects/55d608fc3e544ac08d522367867a17c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:00.153586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] RBAC: Authorizing `identity:get_project(project_id=55d608fc3e544ac08d522367867a17c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:00.155109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.157178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 226/450] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:25:00 2022] GET /identity/v3/projects/55d608fc3e544ac08d522367867a17c0 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:00.162733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:00.176349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:00.177213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:00.177489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:00.177758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] PATH_INFO: `/v3/projects/68110cc172da4f7f98143d7196095a84` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:00.178924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] RBAC: Authorizing `identity:get_project(project_id=68110cc172da4f7f98143d7196095a84)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:00.180384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.182227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 225/451] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:25:00 2022] GET /identity/v3/projects/68110cc172da4f7f98143d7196095a84 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:00.187648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:00.241920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.253644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.262428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3e0e-50bb-4490-8686-916f758d166b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:00.286284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133784-57c7-42a7-b412-d4c02f57b683 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:00.295342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:00.296255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:00.296541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:00.296813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] PATH_INFO: `/v3/groups/2864a2b3447347bb96c53a5465bcff04` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:00.298007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] RBAC: Authorizing `identity:get_group(group_id=2864a2b3447347bb96c53a5465bcff04)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:00.299507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.301140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 227/452] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:25:00 2022] GET /identity/v3/groups/2864a2b3447347bb96c53a5465bcff04 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:00.307170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:00.318485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:00.319385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:00.319668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:00.319943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] PATH_INFO: `/v3/groups/9d51f704dec642f19b0db3424aa2a661` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:00.321114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] RBAC: Authorizing `identity:get_group(group_id=9d51f704dec642f19b0db3424aa2a661)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:00.322553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.328950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 226/453] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 22:25:00 2022] GET /identity/v3/groups/9d51f704dec642f19b0db3424aa2a661 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:00.330035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:00.408261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cfa82-7270-42db-914f-12c9fe528882 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:00.430207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7f64-7129-481a-8828-e91a1cde3107 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:00.441573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:00.442241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:00.442521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:00.442764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:00.443652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] RBAC: Adding query filter params (group.id=2864a2b3447347bb96c53a5465bcff04, role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=55d608fc3e544ac08d522367867a17c0) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:00.443960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:00.445400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36afbe-56c8-46d8-ba7e-f76ec79e0e48 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.451319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 228/454] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:25:00 2022] GET /identity/v3/role_assignments?group.id=2864a2b3447347bb96c53a5465bcff04&scope.project.id=55d608fc3e544ac08d522367867a17c0&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:00.453084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.465006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:00.465714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:00.465996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:00.466265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:00.467143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] RBAC: Adding query filter params (group.id=9d51f704dec642f19b0db3424aa2a661, role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=68110cc172da4f7f98143d7196095a84) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:00.467519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:00.468991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ac9c-bb76-4827-927c-e1a97b90818c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:00.475862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 227/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 22:25:00 2022] GET /identity/v3/role_assignments?group.id=9d51f704dec642f19b0db3424aa2a661&scope.project.id=68110cc172da4f7f98143d7196095a84&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:03.100007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a10ca-8b81-4545-883c-0a56077a2816 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.100536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a10ca-8b81-4545-883c-0a56077a2816 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.100536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a10ca-8b81-4545-883c-0a56077a2816 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.102221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 229/456] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:03.110559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407baed3-fc51-49e7-90df-6dcf9a7dda67 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.111445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407baed3-fc51-49e7-90df-6dcf9a7dda67 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.111923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407baed3-fc51-49e7-90df-6dcf9a7dda67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.136437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-407baed3-fc51-49e7-90df-6dcf9a7dda67 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:03.137995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-407baed3-fc51-49e7-90df-6dcf9a7dda67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:03.233224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 228/457] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:03.270003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a10ca-8b81-4545-883c-0a56077a2816 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:03.302658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:03.389296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b45ae7-bc50-4749-b04e-af5e24b121de None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.389978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b45ae7-bc50-4749-b04e-af5e24b121de None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.390478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b45ae7-bc50-4749-b04e-af5e24b121de None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.392341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 229/458] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:03.399613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa47d1-f5e8-4f60-9221-3b7182b671a0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.400164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa47d1-f5e8-4f60-9221-3b7182b671a0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.400636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa47d1-f5e8-4f60-9221-3b7182b671a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.411678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a10ca-8b81-4545-883c-0a56077a2816 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:03.433927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-54fa47d1-f5e8-4f60-9221-3b7182b671a0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:03.435165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-54fa47d1-f5e8-4f60-9221-3b7182b671a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:03.471952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:03.472759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.473039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.473307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.486511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:03.488001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6c2e8e18-3420-47cf-bb14-4d02a075268c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:03.507004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:03.507916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:03.508738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:03.508738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:03.508738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:03.508738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:03.508738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 230/459] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:03.509757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749766-8bc9-4edb-9ce1-b5c5e46bdf0f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.510035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749766-8bc9-4edb-9ce1-b5c5e46bdf0f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.510312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749766-8bc9-4edb-9ce1-b5c5e46bdf0f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.511793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 231/460] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:03.516573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749766-8bc9-4edb-9ce1-b5c5e46bdf0f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:03.530935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 230/461] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:25:03.538529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.538529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.538529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.565293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:03.567603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:03.615781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:03.617224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:03.643930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 231/462] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:03.644691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:03.651984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749766-8bc9-4edb-9ce1-b5c5e46bdf0f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:03.692534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:03.693207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.693881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.694156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.694884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:03.695527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:03.697246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c88e4-3533-499f-8d10-24d0098269d7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:03.709602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 232/463] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:03.710878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e11a0c-fe09-40a4-bfdd-78b26e4e0505 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.711185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e11a0c-fe09-40a4-bfdd-78b26e4e0505 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.711458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e11a0c-fe09-40a4-bfdd-78b26e4e0505 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.715173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 233/464] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:03.715173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e11a0c-fe09-40a4-bfdd-78b26e4e0505 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:03.762962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f85e-edf6-43a5-a643-fab8905f18eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:03.800572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:03.801379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.801661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.801936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.812806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:03.814215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:03.818766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e11a0c-fe09-40a4-bfdd-78b26e4e0505 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:03.831593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:03.832464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:03.833300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:03.833300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:03.833300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:03.833300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:03.833300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 232/465] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:03.833549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:03.856196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6961299-f056-49f4-9970-669e650696df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:03.857010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961299-f056-49f4-9970-669e650696df None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.857298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961299-f056-49f4-9970-669e650696df None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.857575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6961299-f056-49f4-9970-669e650696df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.860619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:03.867480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:03.870448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6961299-f056-49f4-9970-669e650696df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:03.871938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6961299-f056-49f4-9970-669e650696df None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e6961299-f056-49f4-9970-669e650696df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:03.889063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:03.890106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:03.891175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:03.891175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:03.891175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:03.891175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:03.891175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 234/466] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:03.891502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.891828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.891995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.908458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:03.909560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:03.952354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d8ba-67c2-4dc2-a614-fe4130ced775 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:03.983413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 235/467] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:03.983413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:03.995171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:03.995855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:03.996133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:03.996452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:03.997241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:03.998822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.021295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 233/468] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:25:03 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:04.026175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.115691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2b4cb-1b6a-46fc-adb1-9b314e502f91 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.137256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:04.142145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:04.162227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.162837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.163144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.163765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.164268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:04.164579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.166017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.167377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1416b8-ebe0-4b36-a028-0a3cff011a0f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.185059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 236/469] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:04.186086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.214618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.216230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.216230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.216230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.216814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:04.217127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.218711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.231195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 234/470] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:04.233309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.308158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d51a4-4be0-4ff2-86cb-1f9db6be34ca None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.346215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.347165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.347447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.347738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.352960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f673d-86a9-4307-bc6c-c3e77ebec27d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.359927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.361605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:04.382650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:04.383514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:04.384330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:04.384330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:04.384330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:04.384330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:04.384330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 237/471] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:04.389940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.404759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.405503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.405788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.406061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.406779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.408632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.428570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:04.430382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:04.439163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 235/472] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:25:04 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:04.440425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.557703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6516-d2cc-425e-984b-31e22ea11a74 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.596773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9ce21-836b-4ad9-844c-8e932acd477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.597867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9ce21-836b-4ad9-844c-8e932acd477a None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.598438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9ce21-836b-4ad9-844c-8e932acd477a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.598898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9ce21-836b-4ad9-844c-8e932acd477a None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.599908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9ce21-836b-4ad9-844c-8e932acd477a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.601682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9ce21-836b-4ad9-844c-8e932acd477a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.608596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6eeb9-a010-4f94-a924-ecc80b4d09aa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.626558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 238/473] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:25:04 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:04.627971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c41f-c74d-493d-a029-112e86012e82 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.628255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c41f-c74d-493d-a029-112e86012e82 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.628525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c41f-c74d-493d-a029-112e86012e82 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.629961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 239/474] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:04.636510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.636819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.637021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.656065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.656065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.656065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.656452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.657485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:04.657844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.658121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:04.659960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:04.660159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.683692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 236/475] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:04.688778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.747157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 240/476] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:25:04.767209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:04.768179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:04.788925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:04.803655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faeffa6-b2d5-4620-b615-e7dca8d50553 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.839798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.840428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.840705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.840977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.841677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.843184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.869253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 237/477] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:25:04 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:25:04.886834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d4b4f-2dc2-4f40-a99f-4cd1b545f953 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:04.926357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:04.927349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:04.927766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:04.928220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:04.929153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:04.930790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:04.938878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.sql.core [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 22:25:04.938878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 22:25:04.938878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [parameters: {'id': '171d098993154895855ae4c88448deca', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 22:25:04.938878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 21 22:25:04.956799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:25:04.957906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application yield resource Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise self.value Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application session.commit() Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 22:25:04.959031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.flush() Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application compat.raise_( Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 22:25:04.960079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:25:04.961071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:25:04.961945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [parameters: {'id': '171d098993154895855ae4c88448deca', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:04.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 22:25:04.963756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:04.971153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 241/478] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 22:25:04 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:04.976225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:05.091493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cf591-10ac-41ed-b0cd-d68954b97671 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:05.110304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:05.130663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1186bd-f0cd-4739-a2e1-c61dacc9b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:05.131786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1186bd-f0cd-4739-a2e1-c61dacc9b57a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:05.132205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1186bd-f0cd-4739-a2e1-c61dacc9b57a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:05.132615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1186bd-f0cd-4739-a2e1-c61dacc9b57a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:05.144915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1186bd-f0cd-4739-a2e1-c61dacc9b57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6a1186bd-f0cd-4739-a2e1-c61dacc9b57a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:05.153718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:05.154582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:05.155653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 238/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:05.163137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:05.251393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:05.270338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922515cb-3449-4d58-9b5e-79d98eb11796 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:05.307111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:05.308209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:05.308691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:05.309197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:05.310209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:05.310724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:05.312453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3f8be-9b22-4407-a641-a5146410ba5a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:05.327152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 242/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:06.570562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8e576-61a7-4fdf-b01b-7945ce4a97db None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:06.571135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8e576-61a7-4fdf-b01b-7945ce4a97db None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:06.571135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8e576-61a7-4fdf-b01b-7945ce4a97db None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:06.572764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 239/481] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:06.577977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:06.578381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:06.578559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:06.595692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:06.596876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:06.691768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 243/482] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:06.734137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8e576-61a7-4fdf-b01b-7945ce4a97db None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:06.836937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8e576-61a7-4fdf-b01b-7945ce4a97db None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:06.870535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d0c36-9d31-40d4-b063-d377ec40a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:06.871364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d0c36-9d31-40d4-b063-d377ec40a979 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:06.871640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d0c36-9d31-40d4-b063-d377ec40a979 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:06.871941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d0c36-9d31-40d4-b063-d377ec40a979 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:06.882362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d0c36-9d31-40d4-b063-d377ec40a979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-827d0c36-9d31-40d4-b063-d377ec40a979 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:06.890161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:06.891066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:06.892243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 240/483] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:06.897577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:06.987986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.016244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709de70-9472-459f-b865-12730896299e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.016568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709de70-9472-459f-b865-12730896299e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.016792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709de70-9472-459f-b865-12730896299e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.018434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 241/484] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:07.023827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.024112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.024389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.025460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca0f4-1e9d-4e9b-9a7a-22913ad38095 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.051888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:07.053103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:07.101689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.102368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.102644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.102910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.103701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:07.104002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.105387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.111360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.131086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 244/485] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:07.132436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.165181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 242/486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:07.196005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.270178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30084e6-d36c-4594-9e07-6b4309be2baf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.305328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.306162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.306442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.306710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.306892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffc029-9417-4006-8036-6c022ae8eef7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.308880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.320277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.321926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6e637f56-3fe6-4f6f-b97a-0fc077d5fe25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:07.340415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:07.341266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:07.342552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:07.342552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:07.342552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:07.342552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:07.342552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 245/487] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:07.343088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bfb3a-90f9-49d1-8657-9e194a7cf534 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.343247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bfb3a-90f9-49d1-8657-9e194a7cf534 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.344987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bfb3a-90f9-49d1-8657-9e194a7cf534 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.347474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d59b1-3424-4e78-a6d6-7869c2855e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.348290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d59b1-3424-4e78-a6d6-7869c2855e25 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.348570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d59b1-3424-4e78-a6d6-7869c2855e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.348837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d59b1-3424-4e78-a6d6-7869c2855e25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.348928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 246/488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:07.349686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bfb3a-90f9-49d1-8657-9e194a7cf534 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.359802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d59b1-3424-4e78-a6d6-7869c2855e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-987d59b1-3424-4e78-a6d6-7869c2855e25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:07.367804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:07.368745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:07.369521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:07.379783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 243/489] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:07.381005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.381292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.381565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.403313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:07.404512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:07.427240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.477512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 244/490] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:07.483804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.485587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bfb3a-90f9-49d1-8657-9e194a7cf534 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.525620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.526910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.527620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.528470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.529659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:07.530453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.533090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.549314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 247/491] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:07.553912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.610042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222b15-a7a0-4da0-b00a-662c74b0b81c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.614634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.648184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.648585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.648866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.649136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.649895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:07.650201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.651632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.661068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 245/492] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:07.661984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.674261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18d789-110b-404e-9706-9fc528f99a0d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.681542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.710268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.711442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.711912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.712366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.723226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:07.731520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:07.732358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:07.733157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:07.735592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 248/493] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:07.736573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.775021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2831562-f0fd-4246-b93a-977ae5362e60 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.809759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.810474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.810755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.811056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.819015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.820492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:07.836324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:07.837259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:07.838119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 246/494] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:07.839461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.846228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90c9e-b5ad-44cf-ad9b-76da98de6710 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.853456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.882806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.883639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.883925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.884189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.895439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.896906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-fcd383c1-6b01-4628-8a39-b34c0cf7592a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:07.915168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:07.916031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:07.916863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:07.916863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:07.916863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:07.916863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:07.916863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 249/495] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:07.917630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894f10-92ed-448b-89d5-b002e71c54e9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.917907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894f10-92ed-448b-89d5-b002e71c54e9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.918176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894f10-92ed-448b-89d5-b002e71c54e9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.919443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 250/496] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:07.920120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894f10-92ed-448b-89d5-b002e71c54e9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:07.927172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.949901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea578a7-41bf-42d7-a2f1-146c78293dfe None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:07.985561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:07.987164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:07.987459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:07.987745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:07.988508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:07.988819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:07.990223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:07.998360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 247/497] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:07.999206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.030686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894f10-92ed-448b-89d5-b002e71c54e9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.063317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.063923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.064200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.064469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.065304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:08.065609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.067065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6731c-0c29-429f-8ba5-0dfe51ad67dc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.096760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa0e87-3eb8-4e7d-9692-62674ee6b043 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.103602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 251/498] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:08.104978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.105273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.105552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.121271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:08.122481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:08.130896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.131613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.131908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.132177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.132905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:08.133222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.133645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.134615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922532f7-9279-46fe-8957-3b3c1b3ed39e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.144162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.151143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 248/499] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:08.152792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb674-7bad-4331-8fc0-a288fd7788b8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.153078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb674-7bad-4331-8fc0-a288fd7788b8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.153349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb674-7bad-4331-8fc0-a288fd7788b8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.154595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 249/500] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:08.155304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb674-7bad-4331-8fc0-a288fd7788b8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.190454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 252/501] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:08.191339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.258041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb674-7bad-4331-8fc0-a288fd7788b8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.289131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385bda-410e-4f86-8070-e1e8e529077f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.291599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.292401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.292679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.292949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.303055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.304514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.321660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:08.321797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:08.322764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:08.323668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:08.323668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:08.323668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:08.323668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:08.323883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.323883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.323883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.324057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 250/502] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:08.324057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.340073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.382771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.395432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.396917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.432372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef3b5-1916-400d-9c0c-7042a120febc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.464400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.465197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.465468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.465733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.473149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.474589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-beefac63-0cbe-4172-9cee-46a19c9b80fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:08.489193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:08.490090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:08.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 251/503] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:08.491568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.491796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.492073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.502893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 253/504] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:08.507441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.513017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:08.514224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:08.549572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.579151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 252/505] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:08.580128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.614764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afde31-a786-46a2-9c83-e5168d762547 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.623994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.653186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.653997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.654277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.654550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.664884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:08.672966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:08.673825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 254/506] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:08.679907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.680708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093cf4e-b9f6-443f-8d30-3ac3ba374803 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.712946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.713609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.713880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.714149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.714858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:08.715186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.716584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.727682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 253/507] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:08.728458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.774722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa251bab-6c46-4404-87d6-cbabff733aaa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.781470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.809718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.810376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.810657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.810928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.811805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:08.812114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.813576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.826759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423ec80-44c9-4ef0-bb44-12cfe4921222 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.828409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:08.831016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 255/508] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:08.831846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.861252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.862054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.862332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.862605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.874021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.875580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:08.892695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:08.893558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:08.894392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:08.894392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:08.894392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:08.894392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:08.894609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 254/509] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:08.895595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:08.940889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5669d4-73c5-471a-8794-275ca4cb000a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:08.977041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:08.977842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:08.978138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:08.978408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:08.988625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:08.990104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:09.007943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:09.008895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:09.009716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:09.009716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:09.009716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:09.009716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:09.009918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4bd90-1bb0-4ea1-a1d0-182fdc02eaf1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.009996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 256/510] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:09.009996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.027657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.046551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.047251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.047534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.047810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.048561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:09.048871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.050269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.058060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 255/511] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:09.058842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.077737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.114571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc805d-4a96-483b-9f76-c3c56a54367f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.149839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.150654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.150940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.151245 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.158746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.159947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ea9f-2ca5-48bd-83d7-a87293ab5236 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.160267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:09.176291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:09.177157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:09.178011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 257/512] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:09.178762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.194654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.195362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.195641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.195907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.256248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.261305 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.262793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.280391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.281327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a278-db17-4181-8bfe-0dbc8dc78620 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.318250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.318914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.319223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.319494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.320220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:09.320526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.321921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.338183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 258/513] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:09.338183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.367821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 256/514] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:09.368594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.438372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58a9b-8ae6-4c17-9730-b46e69133e81 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.469538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9833-50fd-4b53-8304-f5d53d9a341a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.471028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.471703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.471979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.472250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.472969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:09.473275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.474654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.477291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.486873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.487511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 259/515] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:09.488404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.512016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.512823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.513096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.513346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.523933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.525415 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:09.542762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:09.543776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:09.544596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:09.544596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:09.544596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:09.544596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:09.544596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 257/516] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:09.544862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.585843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e6bd-f597-4c53-9e6e-82d9eb733277 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.619027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.619666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.619898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.620171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.621072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:09.621384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.622863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.640986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 260/517] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:09.641800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.649191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f49ab3-1abb-45fa-83f3-0b643e3bf854 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.682553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.683469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.683741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.684011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.690639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.692146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.697768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:09.706548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:09.707425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:09.708247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 258/518] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:09.708697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.735915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.744485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a611aca-3bc2-458d-a0d3-1d40aacd6bd1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.779521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.780331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.780688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.780966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.791696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.793162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.806255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28646a-eb0f-4c72-b331-c17626b858c0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:09.810842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:09.811976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:09.812932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:09.812932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:09.812932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:09.812932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:09.812932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 261/519] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:09.812932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.840754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.841440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.841725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.842004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.842707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.844284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.864028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 259/520] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:25:09 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:09.864817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.925850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8d09-ad81-4b9b-9ce2-32df31d94613 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:09.934885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.967697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:09.968461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:09.968744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:09.969020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:09.969765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:09.970074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:09.971537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:09.972140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:09.984816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 262/521] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:09.990397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:09.991751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51caee6-b5da-4a17-ba77-3e0e71cb48b2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.064147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.064827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.065113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.065388 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.149399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8affdb-806f-417a-b83d-e35465b1ed45 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.158813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.160917 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.191834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.192423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.192787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.192953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.193745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:10.194050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.195572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.215368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 263/522] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:10.217185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.252526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:10.276831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:10.307854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 260/523] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:10.307854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.339170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596c6b5-b90e-49e7-b695-20ce2e2ec71d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.383756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.384567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.384915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.385194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.385927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:10.386232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.387886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.404493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 264/524] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:10.405400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.423500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127e1d-bd9f-4a3a-9ae6-507c4f539938 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.456559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.457374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.457658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.457933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.465133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.466565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:10.482895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:10.483980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:10.484912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 261/525] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:10.485503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.499356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:10.516531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa25e84-8d5b-4678-93c1-f38c8f2bca3d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.536124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:10.551852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.552517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.552799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.553286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.553908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d1ef9948ee7a4b2b86b823b7e97a7d77) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:10.554292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.555701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.561490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 265/526] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/role_assignments?user.id=d1ef9948ee7a4b2b86b823b7e97a7d77&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:10.562609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.607241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fe4d9-0d2a-4ba1-97d5-b4de56d4452a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.660689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.662261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.662546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.662820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.678491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.680786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.689532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2d14-c593-4c9a-b49f-9a5995b87916 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:10.706489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:10.707513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:10.708356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:10.708356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:10.708356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:10.708356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:10.709630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 262/527] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:10.709630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.730880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.731911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.732282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.732637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.740673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.742213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:10.758233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:10.759400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:10.760229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:10.765233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 266/528] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:10.766112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.778626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:10.823827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:10.830862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1f9a-a5ee-4923-9434-00b83f7f4796 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.865447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.866124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.866402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.866674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.867534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:10.867838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.869263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.893897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b348-ff14-454e-bdc1-6c8c6fb45370 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:10.907402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:10.908805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:10.941041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:10.941713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:10.941990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:10.942258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:10.943025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:10.943305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:10.944692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:10.965923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 267/530] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:10.965923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.024602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356dfc3-e3ac-40d8-810d-b1fb4b704223 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.043681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.060049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.060718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.060997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.061269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.062156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:11.062396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.063884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.082777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c52d-9b51-4402-8452-9ed12373e211 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.087164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 264/531] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:11.088098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.104346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.122844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.124001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.124892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.125450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.190691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560efb59-ce93-40dc-8998-bd68eaba39b9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.199911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.201744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.226565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.227349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.227621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.227887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.234796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.236455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:11.250427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:11.251316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:11.252141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:11.256371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 265/532] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:11.257179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.279886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.316866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 268/533] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:11.318044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.332976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.358817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ecf2-ba65-4fe7-85dd-91c4fe88a7b8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.400637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.401435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.401567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.401821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.402649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=a0861b19130e41e39a57a61c8972336f) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:11.402956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.404421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.419173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 266/534] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/role_assignments?user.id=a0861b19130e41e39a57a61c8972336f&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:11.420403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.429618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53b01a-10c8-4183-ae61-e9232bf854e3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.480752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.481679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.482123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.482534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.483548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:11.484077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.485795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.499561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 269/535] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:11.516645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.558401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a141e25-c156-423c-aa51-3c18544b3cc3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.567683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.594777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.595634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.595916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.596186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.603793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.608647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.610393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:11.629431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:11.630486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:11.631515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:11.631515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:11.631515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:11.631515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:11.635125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 267/536] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:11.636585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.656989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb9d4-4292-4d36-b896-571d9503a495 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.695656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.697100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.697520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.698021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.699148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=5b5e5657f0c243feaae1824559d6f816) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:11.699618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.701307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.707972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 270/537] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/role_assignments?user.id=5b5e5657f0c243feaae1824559d6f816&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:11.755212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1848b-eb1b-415c-9a1e-c66cfff4c0f4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.793221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:11.793913 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.794189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.794460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.795218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:11.795524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:11.797043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fd5ec-7899-4f72-8aaf-bacbc0b3c957 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:11.814981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 268/538] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:11.820130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:11.960105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:11.967734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39bd36-1962-4c67-bc53-eaebedbd871f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:11.979395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353512-3238-4e4f-b271-1f019701bb11 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.979705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353512-3238-4e4f-b271-1f019701bb11 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.979962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353512-3238-4e4f-b271-1f019701bb11 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:11.981625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 269/539] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:11.988487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:11.988788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:11.989053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.010265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:12.011018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.011310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.011582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.024551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:12.025790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:12.028817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:12.030324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:12.052858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:12.053750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:12.055035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 271/540] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:12.062807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:12.129456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:12.172581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 270/541] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:12.192350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac201-204c-4679-99eb-9e9d0872fcaf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:12.211465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:12.227675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:12.228352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.228636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.228906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.229705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:12.230011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:12.231509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:12.243850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 272/542] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:12.249682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:12.266103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:12.383088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec504e-1814-4fed-bf10-c0508a84b743 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:12.418300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:12.419181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.419560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.419928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.420890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=8255eebd418f42b28a810c7d9e86162f) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:12.421360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:12.421594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223172-37df-48bc-9dc4-0c96e9493008 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:12.422984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:12.429184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 273/543] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:12 2022] GET /identity/v3/role_assignments?user.id=8255eebd418f42b28a810c7d9e86162f&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:12.494726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:12.495585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.495867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.496153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.510536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:12.521744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:12.522607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:12.523852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 271/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:12.530959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:12.633786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:12.656784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b06ea-145e-4a0b-addf-b0356736c204 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:12.693325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:12.694162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.694444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.694770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.695623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:12.695932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:12.697366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a1a67-d1cf-4a9c-935b-cc6efa7427f0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:12.707263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 274/545] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:12.713028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:12.784482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:12.840677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334513d5-e06a-4e9b-b6d9-f174b34d70f8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.840992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334513d5-e06a-4e9b-b6d9-f174b34d70f8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.841278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334513d5-e06a-4e9b-b6d9-f174b34d70f8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.842721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 275/546] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:12.852244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.852529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.852810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.860429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a746f-b0ea-4277-8931-5cdbb94d14c3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:12.891987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:12.893235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:12.896246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:12.897245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:12.897729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:12.898140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:12.911140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:12.913268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:12.932674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:12.933735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:12.934751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:12.934751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:12.934751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:12.934751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:12.937016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 272/547] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:12.942227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.034599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 276/548] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:25:13.072444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.093003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:13.111246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b274-4b68-426c-b8fe-d50b81276d23 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.176889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.177581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.177864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.178141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.178888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:13.179229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:13.180686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:13.196098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:13.209313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 273/549] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:13.214433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.241027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8249a-e5c3-4b1e-934f-2a7e41172b8b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.277712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.278628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.278919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.279215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.290936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:13.299332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:13.300706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:13.301658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 277/550] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:13.309791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.325066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba414ac3-c439-475b-ac34-a2ae7196f3f6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.392633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.393477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.393762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.394042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.406980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:13.416052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:13.433156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5499972-dfd1-41ba-98f2-3443c4e33441 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:13.445861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:13.448310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:13.450520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 274/551] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:13.456270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.474844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:13.490060 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:13.511835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.512526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.512808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.513081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.513847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:13.514155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:13.515611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:13.541428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 278/552] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:13.547466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.589032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6f4c-5e04-49d5-886c-5ebc681c5f3b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.660228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.661305 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.661755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.662174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.663186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:13.663753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:13.665488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:13.685085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1357a-c06e-497d-9cea-e1022a76c3d5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.706417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 275/553] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:13.713187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.737434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.738255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.738535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.738807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.752190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:13.754161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:13.775039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:13.776182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:13.777312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:13.777312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:13.777312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:13.777312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:13.777312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 279/554] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:13.783189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:13.852220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:13.879335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:13.884553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecf968-6e70-423b-8b69-a7a01394e83f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:13.919689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5a50f-f5df-42d7-8217-f6b66ce05cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:13.920408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5a50f-f5df-42d7-8217-f6b66ce05cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:13.920690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5a50f-f5df-42d7-8217-f6b66ce05cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:13.920966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5a50f-f5df-42d7-8217-f6b66ce05cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:13.990666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5a50f-f5df-42d7-8217-f6b66ce05cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:13.992205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5a50f-f5df-42d7-8217-f6b66ce05cb9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.024656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8d4fa-fbed-45e9-8760-cdd061c7b57c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.066030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.066714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.067014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.067324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.068065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:14.068379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.069769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fccd4-301e-47d4-a0f0-77f075639b5d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.082652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 280/555] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:14.086814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffcd9-1745-429b-a4c4-7f19ac44b72b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.087251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffcd9-1745-429b-a4c4-7f19ac44b72b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.087625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ffcd9-1745-429b-a4c4-7f19ac44b72b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.092810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 281/556] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:14.093778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffcd9-1745-429b-a4c4-7f19ac44b72b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.103464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.121558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 276/557] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:14.128585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.128889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.129173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.147234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:14.148682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:14.200182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ffcd9-1745-429b-a4c4-7f19ac44b72b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.202735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.227686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 277/558] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:14.228901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.252937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.253692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.253973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.254246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.268719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.270198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-54a84d6f-69b7-459f-901c-d0950b9b5282 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:14.285343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:14.286738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:14.287706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:14.291372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 282/559] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:14.292808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adaf51-8753-4bea-aff6-4a951a0f59ae None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.293093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adaf51-8753-4bea-aff6-4a951a0f59ae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.293480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adaf51-8753-4bea-aff6-4a951a0f59ae None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.294902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 283/560] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:14.295627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adaf51-8753-4bea-aff6-4a951a0f59ae None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.341441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.346157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4107c-80a2-42e3-bed2-e8550504f4e8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.385760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.386690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.386948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.387255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.397746 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.399278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.414520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adaf51-8753-4bea-aff6-4a951a0f59ae None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:14.418049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:14.418910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:14.419834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:14.419834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:14.419834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:14.419834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:14.424385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 278/561] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:14.424945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.458683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d71eb7-a599-48bb-8eee-962f27f93557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.459772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d71eb7-a599-48bb-8eee-962f27f93557 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.460182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d71eb7-a599-48bb-8eee-962f27f93557 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.460619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d71eb7-a599-48bb-8eee-962f27f93557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.472441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d71eb7-a599-48bb-8eee-962f27f93557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c3d71eb7-a599-48bb-8eee-962f27f93557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:14.480608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:14.481607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:14.482688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:14.484416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 284/562] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:14.485610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.485894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.486169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.503631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:14.504916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:14.524078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.537961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7c50a-11f2-4a04-8a52-99b4bb2f97a0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.573362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.574038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.574317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.574588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.575452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:14.575761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.577225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.583093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 285/563] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:14.583093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.605435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 279/564] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:14.606378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.619529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.693765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc6e0f-5174-4fa2-b9d3-aaa615ed7f17 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.707489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58352247-72ee-4df3-a572-3231b97c7de5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.731234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.732243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.732667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.733095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.734153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:14.734704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.736269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.741856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.742543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.742823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.743133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.743885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:14.744186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.745567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.754524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 280/565] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:14.754815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 286/566] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:14.755460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.756372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.773920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.840378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:14.865904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed0d38-c6a5-467b-8325-2d6fab25ad05 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.873015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0388-de58-4c2f-9447-a3d2c238f805 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:14.901630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.902439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.902724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.903015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.908925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:14.910009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:14.910290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:14.910570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:14.914005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:14.915495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:14.921202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:14.929219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:14.930110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:14.930968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:14.932511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:14.933474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:14.934319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:14.934319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:14.934319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:14.934319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:14.934319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 287/567] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:14.935041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.937267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 281/568] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:14.939362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:14.998407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.033809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1595-c7b3-475e-87bd-121b54bbef5b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.038703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47e24-9238-438b-94f9-ad3b6e927ec3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.066424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.066956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.067255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.067560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.067807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.072410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.073216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.073535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.073883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.075067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.076524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.084818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.086270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:15.090889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:15.091844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:15.092701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 288/569] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:15.093163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:15.116182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:15.117322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:15.118238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:15.118238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:15.118238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:15.118238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:15.118238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 282/570] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:15.118668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.206862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b858931-a815-4859-aebf-bb03015ef825 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.220481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16e09a-5f51-430c-adcb-4009c8a35dec None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.232066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.240986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.241662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.242000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.242279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.243057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:15.243367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.244732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fd170-bffa-4abc-9b05-b62c380588d0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.252613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 289/571] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:15.253997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3cf38-51f5-4f87-837b-c08845230deb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.254287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3cf38-51f5-4f87-837b-c08845230deb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.254562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3cf38-51f5-4f87-837b-c08845230deb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.254876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.255583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.255867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.256046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 290/572] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:15.256152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.256751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3cf38-51f5-4f87-837b-c08845230deb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.256843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:15.257334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.258647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.271964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 283/573] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:15.272864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.317748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.357196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3cf38-51f5-4f87-837b-c08845230deb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.369834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4970-a61c-498d-b057-7a5d4f6c78e6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.390051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.390774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.391094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.391372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.392165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:15.392473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.393909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.405476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 291/574] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:15.406289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.412674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.413349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.413627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.413897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.414619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:15.414924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.416352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c73fc-80f3-4f1d-8a0f-d0c0f20d4e06 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.429239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 284/575] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:15.429841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.430128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.430403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.447945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:15.449170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:15.467750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.518034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d27e9-f385-4e06-9885-3c032fd5aac6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.522703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 285/576] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:15.523561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.551479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.552287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.552566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.552837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.560060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.566184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.567817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:15.585633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:15.586660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:15.587762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:15.587762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:15.587762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:15.587762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:15.587762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 292/577] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:15.591833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.624024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6948c-0bf5-4de3-84f1-ca3129750cb8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.656771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.657575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.658216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.658480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.665105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.666581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:15.680074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:15.681051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 286/578] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:15.682110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.688346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.691813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e0a58-009a-4489-96d8-6f4f889b9bb3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.724836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.725484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.725763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.726034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.726856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d298476d65ba4329b5aea924e7fd5f46) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:15.727195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.728623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.733937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 293/579] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/role_assignments?user.id=d298476d65ba4329b5aea924e7fd5f46&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:15.734729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.781413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.790091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a17e62-529b-446c-8bff-bf668cf6adfb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.832427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.833611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.833890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.834306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.844756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:15.846236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:15.861543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:15.862677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 287/580] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:15.863660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.875649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ec374-88e1-4da4-8b73-ceafe09532d4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:15.915554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:15.916533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:15.916815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:15.917088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:15.928279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:15.936164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:15.937112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 294/581] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:15.943450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:15.965892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:15.980691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e0f1-03f7-4775-a8be-de555dddb7f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.016484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.017158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.017704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.017704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.018425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.018735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.020156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.032138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 288/582] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.033237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.048827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.049164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8add2c-df30-4d43-8136-5853d345b499 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.086541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.087234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.087511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.087780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.088562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.088865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.090285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.103078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 295/583] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.104091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.147735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7099bc2-b3d2-4b5b-b464-914bde231a85 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.184441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.185217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.185501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.185776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.186611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.186910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.188377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.196174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.206856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 289/584] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.207984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.219835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142b336-489d-44a9-95c5-cdddb4942b60 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.254589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.255289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.255569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.255839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.256586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.256897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.258262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.270721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 296/585] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.270721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.287894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.319696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f966cd-52ab-4b9a-aa92-44954613b15c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.354442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.355480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.355818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.356155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.364519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.366027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.367153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554468-d1f1-48a7-ba8e-2e871398295d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:16.384922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:16.385836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:16.386725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 290/586] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:16.388278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.412181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.413105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.413645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.413927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d1ef9948ee7a4b2b86b823b7e97a7d77/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.429039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=d1ef9948ee7a4b2b86b823b7e97a7d77, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.430496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.433573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.455038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 297/587] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:16 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d1ef9948ee7a4b2b86b823b7e97a7d77/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:16.455038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.519971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433617f5-f0af-45e1-ba7a-bf489e2dbf07 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.555219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848b867-4242-4461-8f66-f55cdce1dd77 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.565088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.572384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.573710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.574070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.574421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.591043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.593045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.593524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.594525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.594880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.595236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.606534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.608219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:16.615784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:16.616885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:16.617942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:16.617942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:16.617942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:16.617942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:16.623062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 291/588] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:16.624371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:16.632753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:16.633642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:16.634573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:16.634573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:16.634573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:16.634573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:16.635213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 298/589] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:16.635859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.719857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.744884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7360d-e76f-461b-a561-960f8b213a1a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.764425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df783bb-dc5b-487e-9038-a984102716d7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.781081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.781901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.782241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.782619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.784020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.784397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.786005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.802666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.803817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.804298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.804836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.805366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 292/590] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.806173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.806303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.806953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.808731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.823648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 299/591] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.824890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.854253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.913934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64491a9b-4621-48e4-8b81-140cbbafcc77 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.936370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21df3-c475-4362-9b3d-69c6ceace466 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:16.946205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:16.953878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.954647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.954942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.955242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.956160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:16.956348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.957721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:16.974272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 293/592] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:16.974272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:16.978233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:16.979340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:16.979815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:16.980293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:16.991940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:16.993752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:17.011699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:17.012611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:17.013458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:17.013458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:17.013458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:17.013458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:17.020688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 300/593] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:17.021819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.072892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd59b3-f38b-468f-901e-bc604eb0b000 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.074472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.108750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.109634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.109890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.110224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.117470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.118917 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.133578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534cafc-435e-4755-a419-ff7fb02b3627 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:17.134821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:17.135702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:17.136571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:17.140866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 294/594] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:17.141712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.173433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.174730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.175261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.175729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.184434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.186308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:17.202531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:17.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:25:17.204450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:17.211801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 301/595] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:17.213018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.237068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.245614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059d3f-5205-403f-b2bb-2566676eb758 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.283550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.284568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.285006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.285480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.286333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:17.286799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.288419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.301224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 295/596] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:17.302480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.326265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338496-f871-4741-90e7-5d7c2fe5942e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.334847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.364351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.365263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.365687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.366099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.367271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:17.367760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.369376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.389466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 302/597] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:17.390652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.436229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e3e21-09af-40a3-afee-94a70219ab1e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.471109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.472116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.472643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.473199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.474368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:17.474890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.476537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.485573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.502732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 296/598] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:17.504148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.506747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e81b-eb5b-46ca-bfe4-2057cb0eef5f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.552222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.553020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.553293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.553576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.560421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.561869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:17.575689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:17.576617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:17.577476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 303/599] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:17.582971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.604508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.627519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e679-bc0a-40e2-8670-d9f1846891a2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.669853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.670878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.671185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.671459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/a0861b19130e41e39a57a61c8972336f/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.679919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4331ab-c75a-4a8b-8f04-c58fd923b011 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.690041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=a0861b19130e41e39a57a61c8972336f, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.691658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.712049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 297/600] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:17 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/a0861b19130e41e39a57a61c8972336f/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:17.713507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.720012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.720980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.721632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.721914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.735026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.736593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.737567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-697d8b5b-ce88-4232-8092-a10f1309544d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:17.757789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:17.758767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:17.759676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:17.759676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:17.759676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:17.759676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:17.759901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 304/601] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:17.761613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3254-7fd0-4374-9964-c9fc3afd6226 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.762153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3254-7fd0-4374-9964-c9fc3afd6226 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.762432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3254-7fd0-4374-9964-c9fc3afd6226 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.765005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 305/602] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:17.766038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3254-7fd0-4374-9964-c9fc3afd6226 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:17.868744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfebd29-2453-4b87-9e06-73229a7e76bd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.916168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.925741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.926064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.926341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.926608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.927708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:17.928021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.929642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f2b8b-c7ba-46aa-8af7-d75888032c17 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.934931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3254-7fd0-4374-9964-c9fc3afd6226 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:17.944210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 298/603] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:17.945491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.945775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.946049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.966558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:17.968247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:17.973895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:17.975204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:17.975681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:17.976276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:17.977074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:17.977464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:17.979049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:17.992751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 306/604] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:17.993724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.047978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 299/605] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:18.051253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.057041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.117930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b95c-04bc-4e54-8835-eb1a46013cf7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.157249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.158808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.159380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.159824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/5b5e5657f0c243feaae1824559d6f816/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.176092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=5b5e5657f0c243feaae1824559d6f816, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:18.177858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:18.202650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00521b6-081e-44b7-a79f-6658aac4d05c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.203261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 307/606] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:17 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/5b5e5657f0c243feaae1824559d6f816/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:18.206678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.247459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.261797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.262670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.262955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.263338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.271732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:18.273213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:18.298950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:18.300014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:18.300915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:18.301811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 300/607] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:18.307993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.420551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffa569-e990-4d48-8741-9897b158ce11 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.427329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.490784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.491789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.492066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.492592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.502086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae2c2-6c2c-4c52-af42-32628155a658 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.506887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:18.517169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:18.518129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:18.518933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:18.520080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 308/608] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:18.526303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.540630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.541301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.541579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.541848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.543176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:18.543487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:18.545614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:18.562472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 301/609] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:18.569191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.644945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a44bd-ab35-4df0-bff5-cf44a3299c98 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.666711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.682536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.683170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.683455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.683726 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.684478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:18.684799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:18.686314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:18.699063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 309/610] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:18.701043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:18.756173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:18.758028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d6aa-cb12-445b-ae22-c24459edb843 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.794781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15633b6b-883b-44e8-8b52-ffdba8735af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.795810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15633b6b-883b-44e8-8b52-ffdba8735af6 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.795986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15633b6b-883b-44e8-8b52-ffdba8735af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.796249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15633b6b-883b-44e8-8b52-ffdba8735af6 None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/8255eebd418f42b28a810c7d9e86162f/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.812104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15633b6b-883b-44e8-8b52-ffdba8735af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=8255eebd418f42b28a810c7d9e86162f, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:18.813642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15633b6b-883b-44e8-8b52-ffdba8735af6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:18.830645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 302/611] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:18 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/8255eebd418f42b28a810c7d9e86162f/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:18.832103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a749a2a-7368-4e57-b8fb-63c67fa48d2b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.832559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a749a2a-7368-4e57-b8fb-63c67fa48d2b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.832839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a749a2a-7368-4e57-b8fb-63c67fa48d2b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.834545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 303/612] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:18.837533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3ef5b-743d-41f7-8fd8-a1fd18086e9b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:18.840760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.841372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.841862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.859521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:18.861196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:18.877325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:18.878297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:18.878647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:18.883036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:18.902907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:18.904496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:18.942162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:18.943108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:18.943971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:18.943971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:18.943971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:18.943971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:18.952425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 310/613] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:18.954216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.001360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 304/614] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:25:19.028650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.054047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.079044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.115777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47155-24c9-430b-a760-8b013ad79619 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.178872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:19.179570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:19.179847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:19.180115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:19.180837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:19.181139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:19.182534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:19.190090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2365fb2-66e6-430e-a780-70fe19c8e91e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.209610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 311/615] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:19.214131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.250908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:19.251743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:19.252018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:19.252282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:19.272116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:19.279938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:19.280839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:19.281671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:19.291049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 305/616] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:19.293661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.381445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ecff-4b87-4b43-9761-6eff1d188942 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.443315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:19.444123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:19.444398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:19.444664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:19.447106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.456704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.462668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:19.464213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:19.480370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:19.481318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:19.482437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 312/617] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:19.488331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.492224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd7ada-94ac-480e-b080-539bd83b721b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.565651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:19.566353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:19.566629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:19.566900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:19.567678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:19.567989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:19.570108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:19.588353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 306/618] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:19.594148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.674244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40464dc0-33be-4b2a-b705-c0523ebb9907 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.733614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde1719-adff-438e-a6ef-4a0c4663cb54 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.740657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:19.741349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:19.741621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:19.742203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:19.742743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:19.743073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:19.744600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:19.769165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:19.770327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:19.770812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:19.771303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:19.782481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:19.791024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 313/619] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:19.791024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.794202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:19.816589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:19.817649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:19.818493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:19.818493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:19.818493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:19.818493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:19.820556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.825249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 307/620] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:19.832302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:19.884643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:19.943680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fd20-fbe0-47b5-b615-fdf92e99dede None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:19.963226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a306-2d6b-41cc-abd6-b42feef47697 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.011642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.012241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.012522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.012796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.013525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:20.013833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.015389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5357a11-1add-4016-9902-09ac702ed48e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.019663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.020667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.021134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.021572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.029072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 308/621] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:20.030957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a438d2-6014-40a4-92c1-7beed673cb60 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.031316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a438d2-6014-40a4-92c1-7beed673cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.031592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a438d2-6014-40a4-92c1-7beed673cb60 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.035060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 309/622] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:20.036050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a438d2-6014-40a4-92c1-7beed673cb60 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.039997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.041653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ad738377-0492-49da-9a2a-409246d26ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:20.064027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:20.064951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:20.065814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:20.065814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:20.065814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:20.065814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:20.068788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 314/623] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:20.070714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.071485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.071979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.092668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:20.094911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:20.106420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.168767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a438d2-6014-40a4-92c1-7beed673cb60 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.182716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 315/624] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:20.183976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.226632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.227534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.228083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.228366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.238891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.240796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.242288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:20.261050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:20.262525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 310/625] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:20.266529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.325522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dbc7c-17b7-4388-89dd-5783bbde84d2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.369611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38868455-8337-4291-8609-0cc37784e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.370294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868455-8337-4291-8609-0cc37784e753 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.370574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868455-8337-4291-8609-0cc37784e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.370849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868455-8337-4291-8609-0cc37784e753 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.371900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38868455-8337-4291-8609-0cc37784e753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:20.372213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38868455-8337-4291-8609-0cc37784e753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.374374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38868455-8337-4291-8609-0cc37784e753 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.386742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb03d0-fa02-4c44-8e4f-f163c78450e1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.389183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 316/626] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:20.391031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38868455-8337-4291-8609-0cc37784e753 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.403971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.427600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.428770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.429271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.429770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.441795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:20.450589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:20.451490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:20.452304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:20.455132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 311/627] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:20.456161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.504253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.517855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38868455-8337-4291-8609-0cc37784e753 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.560137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.561173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.561643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.562101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.563202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:20.563805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.565475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.575663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b829b81-6e2b-4377-b3fd-6a4ed82ae774 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.583545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 317/628] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:20.584609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.614526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.615373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.615657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.615931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.622885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.624387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7f89d071-ded4-438a-b171-182fe2d96718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:20.638744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:20.639665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:20.640552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:20.644893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 312/629] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:20.646259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39bc44-78bc-4795-8333-a3f214d4670c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.646551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39bc44-78bc-4795-8333-a3f214d4670c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.646827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39bc44-78bc-4795-8333-a3f214d4670c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.648263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 313/630] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:20.648820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39bc44-78bc-4795-8333-a3f214d4670c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.685548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.696859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a4837-cf43-4713-a8e8-d123eefb8a94 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.733155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.733807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.734090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.734422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.735214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:20.735524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.736913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.745294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 318/631] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:20.746202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.759614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39bc44-78bc-4795-8333-a3f214d4670c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.765248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.795559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.796129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.796410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.796686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.852164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7f28-b6e8-4706-a197-922dcb18f6d3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:20.865546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.867059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.888785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:20.889963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.890247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.890700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.891534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:20.891849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:20.893282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508b76a-79bf-4c41-b9c1-1e28af6a1506 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:20.902610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.911983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 319/632] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:20.911983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:20.911983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:20.911983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:20.925804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:20.927058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:20.980757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 314/633] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:20.981609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:20.996568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 320/634] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:20.997684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.013268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.104313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb28042-0010-4d57-a775-fa78b262d9ce None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.111084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565bf60-b247-40ca-bdd9-1ac7237447ef None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.144055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.144863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.145147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.145422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.147074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.147724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.147972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.148248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.148521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d298476d65ba4329b5aea924e7fd5f46/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.157249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.159139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.165309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=d298476d65ba4329b5aea924e7fd5f46, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.166769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:21.177500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:21.178535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:21.179681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:21.179681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:21.179681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:21.179681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:21.179681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 315/635] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:21.179991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.183435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 321/636] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:20 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d298476d65ba4329b5aea924e7fd5f46/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:21.184275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.249929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.289092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b273-32dd-435f-ba80-e2164c93150f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.304611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c303e-5f1f-4929-adaa-feaa3d5ace17 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.327280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.328293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.329058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.329330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.342718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.344293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.345060 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.345976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.346257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.346531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.357725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-98bb1714-a225-46c3-8c83-549dae8f1076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:21.362431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:21.363323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:21.364172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:21.364172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:21.364172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:21.364172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:21.364172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 316/637] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:21.364936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997440d-b0f4-4934-b07e-128ac36f89c6 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.365192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997440d-b0f4-4934-b07e-128ac36f89c6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.365436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997440d-b0f4-4934-b07e-128ac36f89c6 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:21.365655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:21.366500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:21.367518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:21.369181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 317/638] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:21.369181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997440d-b0f4-4934-b07e-128ac36f89c6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.378276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 322/639] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:21.378276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.410769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.478658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997440d-b0f4-4934-b07e-128ac36f89c6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.484594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39171328-744d-4f79-b11d-4756536973d0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.503046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.514668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.515374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.515863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.516137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.517408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:21.517805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.519225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb598-febc-443a-b437-24f92c86fd5d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.520983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.521653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.521933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.522198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.522931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:21.523272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.524626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.533963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 318/640] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:21.535476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.535763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.536033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.541366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 323/641] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:21.542444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.557695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:21.559518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:21.641733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 319/642] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:21.642312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.657318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988877e9-23d9-49eb-976f-634fb061b0db None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.673080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.696746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.697423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.697698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.697956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.698710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:21.699040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.700476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.709014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 324/643] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:21.714171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.747625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93428a9-3a94-47b2-b226-a5aab50280ec None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.756088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.785876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.786684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.786959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.787258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.794381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.795862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:21.811883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:21.812953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:21.813869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:21.818051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 320/644] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:21.818887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.820170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c1463-53c7-4927-979e-02221060aa94 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.856164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.857071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.857356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.857626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.867465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:21.869310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:21.886383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:21.887373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:21.888428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:21.892415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 325/645] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:21.893351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:21.923381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:21.938749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08103-7027-40b7-a276-d2ac5e2c1735 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:21.982103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:21.982944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:21.983257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:21.983528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:21.993772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:22.001615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:22.002550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:22.003423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 321/646] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:22.004448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.016095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.022033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ccb9-7164-4d7e-8db3-5b47822804ce None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.059937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.060979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.061770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.062188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.075280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.077331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:22.096675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:22.097541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:22.098407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:22.098407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:22.098407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:22.098407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:22.098407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 326/647] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:22.098693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.114375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794915e-cfa0-43c3-94ab-de49551739f3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.149754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.150351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.150631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.150906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.151771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:22.152079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.153511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.175999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 322/648] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:22.175999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.183691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.213128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d26d95-feda-4e6d-b307-28be053c92d5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.255390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.256069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.256353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.256629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.257436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:22.257747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.259226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.277193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 327/649] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:22.278298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.285506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9e89-a858-4d30-9ffd-67136d89eaac None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.293161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.322589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.323327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.323578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.323850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.324599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:22.324906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.326287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.334480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 323/650] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:22.335310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.399195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f768f-2b7b-4ce5-a060-cca0818bf43c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.415216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.434963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.435658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.435939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.436210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.436936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:22.437242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.438697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.455137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 328/651] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:22.455137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.458713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c986-c7be-4d34-94c7-aa545d82b58b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.492618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.493275 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.493556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.493827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.527827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.561775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb1da-26a9-4c43-af9a-8b3d1dbaedad None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.562399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.563952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.599482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.600143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.600425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.600699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.601615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d1ef9948ee7a4b2b86b823b7e97a7d77) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:22.601924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.603774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.610741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 329/652] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/role_assignments?user.id=d1ef9948ee7a4b2b86b823b7e97a7d77&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:22.610741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.647459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.690899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 324/653] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:22.692144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.752695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb434-254d-44d6-bdf1-213501ebdc6b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.803303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.804131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.804863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.805142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.807620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.818402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d3b7-0147-4e94-a716-a6cbe1fdca3b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:22.822577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.824291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:22.845079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:22.845988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:22.846917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:22.846917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:22.846917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:22.846917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:22.846917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 330/654] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:22.847679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.863193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:22.864065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:22.864349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:22.864624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:22.874254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:22.875797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:22.892639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:22.893607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 325/655] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:22.896120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:22.929121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:22.981312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39cff-2679-4c12-a121-de15db2c380e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.027020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.027020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.027020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.027020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.039015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.040280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.047055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22135f-641c-4702-939d-d37506289e15 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:23.062025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:23.062938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:23.063840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:23.063840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:23.063840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:23.063840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:23.063840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 331/656] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:23.063840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.112988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:23.113186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.116118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.116118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.116118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.116118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:23.116118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.121797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.136403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 326/657] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:23.136634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.193580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50499d90-ef36-44a6-be71-e6486c0456a7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.238540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.239193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.239435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.240460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.240577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:23.247037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.247037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.267346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 332/658] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:23.268309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.279397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:23.293644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414085d3-2770-48db-89f3-2d958598cb38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.331492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.332207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.332440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.332713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.333433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:23.334436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.336010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aa8d4-676f-4f70-b5d2-df8058da8363 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.348373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 327/659] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:23.349395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0afad-0c65-41ef-b368-add284be0d1a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.349676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0afad-0c65-41ef-b368-add284be0d1a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.349946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0afad-0c65-41ef-b368-add284be0d1a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.355311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 328/660] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:23.356128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0afad-0c65-41ef-b368-add284be0d1a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.388628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:23.395671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a806b04-04ab-411f-ace2-093783c643c8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.434711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.435562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.435838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.436110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.445173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.447091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:23.463025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:23.464182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:25:23.465301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:23.472383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 333/661] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:23.473542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.491049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0afad-0c65-41ef-b368-add284be0d1a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.533836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.535160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.535535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.535901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.557812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:23.599537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d62dfa-2d28-4d94-998c-fdff436fddca None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.611576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.613059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.634751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.635625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.635908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.636174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.642954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.644407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-70c65626-ec3a-4af9-ac8a-891b7d5ffa52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:23.658112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:23.659444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 334/662] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.665515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.666111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.681467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:23.682741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:23.694667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:23.718245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 329/663] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:23.718245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.758527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 335/664] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:23.759330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.773453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:23.827222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4148-fc31-4d60-aa62-d9cc2124a53f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.862095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.862585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad1af1-13dc-477e-b0be-af3c7a7b1945 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:23.862771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.863075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.863345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.864282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:23.864588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.866189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.893200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 330/665] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:23.894557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.901022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:23.901695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:23.901979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:23.902252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:23.903074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:23.903415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:23.904828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:23.918164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 336/666] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:23.919686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:23.930379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.008873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a671-b8d8-4769-a904-a439bc7e1741 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.016752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.031304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacaa31-7dd2-4893-8dea-0664f04f06a7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.048122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.048905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.049187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.049465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.060407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.061879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.065419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.066225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.066511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.066786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.077063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:24.080263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:24.081174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:24.082124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:24.082124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:24.082124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:24.082124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:24.082124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 331/667] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:24.082806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:24.089926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:24.090904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:24.091773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 337/668] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:24.092481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.162225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.186707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3f9b6-a1aa-4d5f-a50d-b1e9dbcd0bd8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.201103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817db7a-4d69-47ba-bb56-ba985fccb51b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.222302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.223123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.223406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.223676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.235141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.235799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.236075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.236421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.237177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=a0861b19130e41e39a57a61c8972336f) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:24.237483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.239039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.255304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 338/669] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/role_assignments?user.id=a0861b19130e41e39a57a61c8972336f&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:24.255304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.264672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.311502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.313037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.397272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe54bb7-1f35-4cd2-ac93-a9c4024bb27b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.430828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.432993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 332/670] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:24.434092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.439969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.440659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.440943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.441220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.441994 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:24.442306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.444493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.459627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 339/671] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:24.460540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.504403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.553970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892091-cefb-4347-99e8-4939829dc5a0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.584952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c61d6-674b-4dc1-a9e7-f5cd17d13d35 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.592480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.593162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.593439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.593707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.594634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:24.594934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.597060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.609253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 333/672] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:24.610193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.626025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.626968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.627353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.627703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.641210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.643506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:24.665762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:24.667363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:24.669235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:24.669235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:24.669235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:24.669235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:24.669235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 340/673] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:24.669572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.725829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.729457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc828-d8fa-48d6-bf16-214f9e02477a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.751006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.766091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.767429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.767865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.768287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.775903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.777660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.790102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834320d3-7243-4c03-b9e5-e8212292b302 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:24.793868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:24.794784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:24.795679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:24.798188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 334/674] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:24.799284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.829406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.830165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.830568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.830865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.842341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.844216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:24.867518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:24.868499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:24.869389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:24.869389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:24.869389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:24.869389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:24.870029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 341/675] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:24.870439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.911580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be7a6a-0854-4ab6-ab7e-c985e95a1425 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:24.946352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:24.947138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.947423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.947700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.948437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:24.948743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:24.950160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e38287-81ff-4406-b428-f95db62efef6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:24.964411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 335/676] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:24.965755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f388f-8b9a-486a-902d-c58a6ea64e0d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:24.966113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f388f-8b9a-486a-902d-c58a6ea64e0d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:24.966311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f388f-8b9a-486a-902d-c58a6ea64e0d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:24.971138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 336/677] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:24.971138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f388f-8b9a-486a-902d-c58a6ea64e0d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:24.987241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:24.994843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c49a99-26a4-44cc-beed-b2130777973b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.025059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.034851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.035608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.036037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.036354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.037328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:25.037636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.039302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.057546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 342/678] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:25.058219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.090505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f388f-8b9a-486a-902d-c58a6ea64e0d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.126169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.126855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.127168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.127443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.128418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:25.128739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.131014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935246ad-c401-4927-a579-bec1604830a8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.146302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 337/679] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:25.147611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.147902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.148179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.165251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f6801-b248-45f8-a7a6-9ce0491b02f4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.169512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:25.170707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:25.199794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.200725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.201300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.201624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.209906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.211530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:25.225918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:25.226770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:25.227667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 343/680] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:25.228141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.242661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 338/681] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:25.243879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.250623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.279355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.350636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544188b1-df89-49c4-bda5-69cae1e2c519 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.358494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adf3b-9713-46dd-8376-ec22905ced41 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.394189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.395022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.395324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.395601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.397676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.398617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.398731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.398958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.399843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=5b5e5657f0c243feaae1824559d6f816) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:25.400152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.401615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.403369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.404811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.407667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 344/682] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/role_assignments?user.id=5b5e5657f0c243feaae1824559d6f816&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:25.408891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:25.431939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:25.433064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:25.434417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:25.441606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 339/683] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:25.441606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.523550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.549469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.557630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9b3e0-66b8-4b81-b7ec-48d28d736195 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.563114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72f65-d6f8-4b19-8daf-ce23d931edb8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.606094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.607044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.607464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.607886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.608785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:25.609736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.610747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.615309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.616138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.616410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.616686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.623599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 345/684] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:25.624440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.628898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:25.637681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:25.638622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:25.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 340/685] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:25.640197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.741673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff33d0-0b62-4990-bbe3-84b62ed5216e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.771652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432cdcd-048b-4e8e-93a9-4b9d8229a83b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.777939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.778927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.779475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.779951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.781000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:25.781571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.783262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.792532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.802948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 346/686] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:25.804181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.815367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.816059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.816337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.816879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:25.817436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=8255eebd418f42b28a810c7d9e86162f) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:25.817743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:25.819206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:25.825947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 341/687] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/role_assignments?user.id=8255eebd418f42b28a810c7d9e86162f&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:25.831111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:25.849097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:25.943905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da7b5-5163-4d4d-8780-29e21c43cf22 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.987677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b34a5-e67c-45d9-a831-de079a6f2fb2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:25.988592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:25.989494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:25.989963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:25.992297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.053871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.054578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.054859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.055159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.055944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:26.056254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.057677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.076452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 347/688] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:26.082625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.113750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.115376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.136813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.166736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.212673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70e546-73ea-4dba-9001-be1eb5941767 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.238187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 342/689] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:26.243739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.254848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.256499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.256996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.257462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.269492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.271123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:26.290133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:26.291118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:26.292019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:26.292019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:26.292019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:26.292019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:26.292019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 348/690] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:26.297121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.392876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e1fd3-766c-43f7-b83a-8e42c945d2f8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.420959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.459393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.460213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.460496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.460766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.473364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.474745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.477527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf213ca-09ab-4955-a8f2-7e76051f34f8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.488845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-70d0c1f9-27e2-4122-9090-28f19e9240fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:26.492949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:26.494000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:26.495161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:26.495161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:26.495161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:26.495161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:26.495161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 343/691] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:26.496123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef13e-0284-4ab2-958d-df359e0e5dff None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.496466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef13e-0284-4ab2-958d-df359e0e5dff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.496750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccef13e-0284-4ab2-958d-df359e0e5dff None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.502183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 344/692] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:26.502973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef13e-0284-4ab2-958d-df359e0e5dff None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.518416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.519604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.520054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.520472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.521349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:26.521818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.523641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ac955-9ccf-4170-82d5-0ce8cfb9b847 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.537506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 349/693] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:26.539114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.539617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.540098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.558618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:26.560421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:26.612854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccef13e-0284-4ab2-958d-df359e0e5dff None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.631324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 350/694] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:26.632545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.667501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.668243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.668514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.668790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.669518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:26.669832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.671250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.683617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 345/695] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:26.684532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.720413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.743486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.747893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd9f0-3dc3-4406-91ca-37516e7bee78 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.787635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.788971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.789528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.790026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.794909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509994-f89d-4c3f-b26f-f8396b758eed None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.808035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.810240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:26.831956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:26.832947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:26.833865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:26.836553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:26.837067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 351/696] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:26.837272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:26.837650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:26.837955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:26.838644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:26.839030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.840171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:26.856034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:26.857048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:26.863051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 346/697] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:26.863901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:26.973264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee9776-57bf-45c1-8a3a-9b1662d96a84 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:26.978265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:26.992807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcdbfd-7e9e-4085-8edc-ecaaca8932cd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.017267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.018633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.019280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.020063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.029533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.030491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.031208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.031488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.031856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.032269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.032689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:27.033008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.035064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:27.051290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:27.052164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:27.053025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:27.055641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 352/698] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:27.056628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.059290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 347/699] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:25:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:27.060454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.086742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.180206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6eb00-0774-4cdf-8326-4ee635a53173 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.198474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b44b-32fc-4319-87a2-f7c7f9e45bee None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.225497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.226835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.227601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.228458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.229649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:27.230200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.232786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.236205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.236871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.237184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.237502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.244992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 353/700] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:27.244992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.261375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.318390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.320011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.344354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.362610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fe4b-7b11-4430-8fcb-1d7cb4af1134 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.403341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.404418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.404998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.405541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.406535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:27.407222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.409244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.422799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 354/701] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:27.424037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.439812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 348/702] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:27.440811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.491356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.532011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077b8e5-e54e-4199-905a-afb81ad813bb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.545076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadf420-4464-438b-a66f-42d7bf5ec64b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.568538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.569588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.570071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.570541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.571612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:27.572136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.573760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.580154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.580811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.581085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.581351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.582731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d298476d65ba4329b5aea924e7fd5f46) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:27.582731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.590947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34f6a6-66b0-49c2-bbb7-d55b03bcace4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.591463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 355/704] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:27.592870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.595154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 349/704] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/role_assignments?user.id=d298476d65ba4329b5aea924e7fd5f46&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:27.610618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.752816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947d6a3-079e-40c7-b6d9-4a208b9a71ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:27.755224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bca7fd-7605-41b1-8481-a3a55407f0ae None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.755515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bca7fd-7605-41b1-8481-a3a55407f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.755794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bca7fd-7605-41b1-8481-a3a55407f0ae None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.757475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 350/705] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:27.763466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.763790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.764026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.782815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:27.784424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:27.799494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:27.801039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:27.801700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:27.802115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:27.827221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:27.828770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:27.855453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:27.856388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:27.857244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:27.857244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:27.857244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:27.857244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:27.857457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 356/706] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:27.863104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.874697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 351/707] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:25:27.908133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:27.948876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.961826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:27.996291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e6c4-93fb-4074-a837-a695a675fdf9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.024268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d139c1-b119-425e-9605-be0f4c996d9b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.035672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.036227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.036511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.036789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.037646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:28.037958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.040343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.054156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 357/708] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:28.059939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.065603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.066749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.067314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.067773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.079722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.081540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:28.101445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:28.102354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:28.103264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:28.103264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:28.103264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:28.103264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:28.105557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 352/709] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:28.112337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.195100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d5ea-a021-41eb-9c1d-18e7329c744c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.224467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:28.241539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.242359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.242641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.242914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.258983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.262002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:28.282085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:28.283379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:28.284710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:28.285906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 358/710] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:28.293133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.306195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848d08b-b71c-4784-8e9a-3ffe60196e4c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.323364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:28.342750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.343469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.343888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.344318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.345145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:28.345517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.346967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e2b9e-5006-44e2-a118-3d8fa963de9b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.360043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 353/711] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:28.361857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e083-7df8-4c5a-9004-6e441233b457 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.362215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e083-7df8-4c5a-9004-6e441233b457 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.362559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e083-7df8-4c5a-9004-6e441233b457 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.368110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 354/712] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:28.368985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e083-7df8-4c5a-9004-6e441233b457 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.400732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a35ae-6fc5-49ac-8cfe-c7d32ec69973 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.436305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.436978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.437262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.437536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.438476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:28.438787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.440303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a23451-b365-44d4-a6e6-32769acef052 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.458336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 359/713] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:28.459769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.460063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.460342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.479606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:28.481620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:28.484554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e083-7df8-4c5a-9004-6e441233b457 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.518090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:28.524787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.526173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.526652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.527217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.529366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.531202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.559015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 360/714] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:28.559015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.560662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 355/715] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:25:28 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:28.580181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.596075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:28.667120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49770498-a038-4f06-b38f-cf510d7e388c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.700862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f000953-c503-40dd-b665-bb7a5f12da46 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.705151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.705151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.705484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.705701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.706469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d1ef9948ee7a4b2b86b823b7e97a7d77) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:28.706840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.708501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.715663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 361/716] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/role_assignments?user.id=d1ef9948ee7a4b2b86b823b7e97a7d77&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:28.744141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.745383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.745859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.747644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] PATH_INFO: `/v3/services/network` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.748607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.750255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:28.763750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:28.764802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:28.765609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:28.768713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 356/717] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:28.775176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:28.833174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:28.925373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120533ff-d355-4353-92e8-b430c1c99fb7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:28.961113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:28.961792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:28.962074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:28.962345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:28.963096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] RBAC: Adding query filter params (name=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:28.963412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:28.964800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42c96d-008f-456e-8fda-05103e65d39b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:28.969854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 362/718] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:28.975279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:29.068940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:29.099742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077367ec-3db8-4157-b681-4a37a008be8b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:29.145572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:29.146265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:29.146599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:29.147032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:29.148089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:29.148451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:29.149854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae77-5d1f-4790-920c-3e2b4764c0ab None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:29.158452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 357/719] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:30.096030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5d053-4f9f-43a6-8cbc-ebce7361c5e4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.097083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5d053-4f9f-43a6-8cbc-ebce7361c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.097569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5d053-4f9f-43a6-8cbc-ebce7361c5e4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.099419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 363/720] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:30.105161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.105981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.106461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.123637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:30.125136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:30.212642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9628f9-eb2e-401c-82e7-ce0d43b5fc86 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.212996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9628f9-eb2e-401c-82e7-ce0d43b5fc86 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.213199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9628f9-eb2e-401c-82e7-ce0d43b5fc86 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.214833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 364/721] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:30.220184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.220468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.220748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.226144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 358/722] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:30.248735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:30.257822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:30.260904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:30.354536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:30.379098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 365/723] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:30.405642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:30.426062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615312-8c63-42a8-9ce9-bdbc42d8e1a4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:30.450700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:30.496174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:30.497142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.497507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.497785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.498510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:30.499924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:30.531191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 359/724] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:25:30 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:30.583584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83bb1f-d21c-480c-9367-e496a664078d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:30.640319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:30.641592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.642070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.642558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.660175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:30.668882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:30.669814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:30.670632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:30.673544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 366/725] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:30.679882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:30.794137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e977f-5829-49ba-beb5-cf8f3efe6799 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:30.824336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:30.833533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:30.834586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:30.835115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:30.835756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:30.836940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:30.837644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:30.839404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:30.849001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 360/726] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:30.854769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:30.945219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:30.962751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa083ec6-c13a-4365-9f42-1a2668e5c316 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.001638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.002456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.002735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.003021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.014233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:31.015735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-41065f70-68da-408c-8a8f-692c028fb0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:31.035233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:31.036168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:31.037038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:31.037038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:31.037038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:31.037038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:31.037038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 367/727] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:31.043200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.158429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588fd3-56bb-4fd0-a3bb-78da70f090e7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.159380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588fd3-56bb-4fd0-a3bb-78da70f090e7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.159380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588fd3-56bb-4fd0-a3bb-78da70f090e7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.161032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 368/728] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:31.166282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.166602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.166823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.167193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b2fbe-f576-4d75-9e2a-996a6f03c8cf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.196760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:31.197964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:31.203389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.204402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.204896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.205363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.206279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:31.206806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:31.208394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:31.221335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 361/729] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:31.227039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.277875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.329417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251bed5-2a3a-48c5-a666-3d89ee7bf912 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.348233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 369/730] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:31.365258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.366319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.366746 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.367187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.379791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.384358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:31.385983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:31.401146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:31.402126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:31.403079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:31.405690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 362/731] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:31.411835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.494491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.513577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f688ff-a484-4c77-a39c-7d3c28884594 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.524822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.536103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75d52e-2747-48c5-a7c8-95805e6c31e9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.549998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.550924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.551333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.551701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.552752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:31.553172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:31.554798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6aeb-1303-4140-8a41-6d3c21d1a657 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:31.576119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d3351-a582-47a6-a032-4f96ace9bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.576940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d3351-a582-47a6-a032-4f96ace9bd32 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.577222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d3351-a582-47a6-a032-4f96ace9bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.577494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d3351-a582-47a6-a032-4f96ace9bd32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.579665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 363/732] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:31.581185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e607-139b-4e10-9208-99c4afd27766 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.581478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e607-139b-4e10-9208-99c4afd27766 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.581755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e607-139b-4e10-9208-99c4afd27766 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.583358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 364/733] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:31.584065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e607-139b-4e10-9208-99c4afd27766 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.588614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d3351-a582-47a6-a032-4f96ace9bd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-883d3351-a582-47a6-a032-4f96ace9bd32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:31.596826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:31.597752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:31.598584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 370/734] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:31.603754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.604047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.604325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.621890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:31.623119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:31.689426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e607-139b-4e10-9208-99c4afd27766 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.691835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 371/735] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:31.692768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.726481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.727273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.727556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.727828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.749619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.768418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.795421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bde18-3db7-424e-8581-0c952f0c6cae None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.806853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:31.808372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:31.830831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.831539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.831822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.832099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:31.832959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:31.833335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:31.834783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:31.848911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 372/736] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:31.849838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.916868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 365/737] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:31.917956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:31.954413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18bbf5-7e20-45f0-9334-704a97638248 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:31.971206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.989620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:31.990140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.990703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:31.990920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:31.991253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.001499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:32.009343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:32.010324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:32.011192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 373/738] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:32.011890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.032837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b43f-e869-4cb7-addf-9a21924bd571 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.068561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.069621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.070073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.070617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.083474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.085371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c9845f0e-cc3d-42d3-b0e9-732b04944804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:32.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:32.105027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:32.106287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:32.106287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:32.106287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:32.106287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:32.106882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 366/739] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:32.108109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef629-e375-4aa7-90e0-feb1bc00f92f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.108392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef629-e375-4aa7-90e0-feb1bc00f92f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.108665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdef629-e375-4aa7-90e0-feb1bc00f92f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.114271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 367/740] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:32.114271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef629-e375-4aa7-90e0-feb1bc00f92f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.126376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f36c-0b68-4232-ae5c-195b3a478b6b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.163612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.164453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.164736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.165010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.177014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.178492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:32.196181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:32.197274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:32.198333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:32.198333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:32.198333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:32.198333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:32.202080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 374/741] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:32.202981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.233766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdef629-e375-4aa7-90e0-feb1bc00f92f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.236495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:32.256453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:32.271042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.271736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.272297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.273050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:32.273356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.274789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da8c60-d6c4-4f93-8cc8-010964b12e7a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.283362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 368/742] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:32.284941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.285231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.285507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.302059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:32.303327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:32.322682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20366378-9b01-4745-9179-f270d49859e3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.357542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.358207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.358650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.358924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.359725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:32.360035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.361690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.379020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 369/743] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:25:32.379020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.383134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 375/744] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:32.383134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.479431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:32.491324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825324c-1272-457f-a8d7-a1d449bd9597 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.495493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80facd82-1629-4f06-9875-ffa6775662e2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.509190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:32.527807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.528618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.528904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.529176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.533151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.533878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.534516 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.534788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.535536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:32.535844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.537226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.539973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.541411 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.553529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 370/745] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:32.553529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:32.564532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:32.565422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:32.566279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:32.566279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:32.566279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:32.566279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:32.566279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 376/746] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:32.566558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.657758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af543479-eddd-4074-8ec8-e41d1f10884c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.676489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c42b3e-bff9-4eaf-ba9a-9fd35f9ddd6e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.692274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.693098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.693376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.693648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.701532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.703013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.713787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.714460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.714743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.715042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.715770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.717134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:32.717398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:32.718376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 371/747] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:32.724550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.747023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 377/748] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:25:32 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:32.747023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.747023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:32.770457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:32.864387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bea4f-ad2e-449e-90b2-d8ecbdbe087b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.870050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc99b3-f51b-4d7b-8648-ea9300a8645c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:32.906955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.907984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.908367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.908741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.910148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:32.910556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.911142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:32.911965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:32.912249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:32.912352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.912519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:32.923138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:32.924897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:32.927193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 378/749] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:32.928217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:32.946308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:32.947284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:32.948166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:32.948586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 372/750] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:32.949767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.012958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.061531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.070155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735370f2-4db9-40fe-a6e7-0a359caadb8e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.074200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35120f24-77ed-48e0-a399-f5850d605ace None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.110310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.110985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.111303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.111572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.112414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:33.112716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.114151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.118027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.118856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.119170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.119443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.127380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.129022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.133261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 379/751] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:33.134421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4987e72c-c37a-4d1d-9e9b-5ff68b1a5383 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:33.144578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:33.145554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:33.146464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 373/752] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:25:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:33.147812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ef79-e354-4b71-96e2-b318d83dc806 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.147812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ef79-e354-4b71-96e2-b318d83dc806 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.147964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ef79-e354-4b71-96e2-b318d83dc806 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.151113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 374/753] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:33.152299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ef79-e354-4b71-96e2-b318d83dc806 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.242100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174c8c1-cce4-4a6e-8d4d-4650d1a5184f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.258679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ef79-e354-4b71-96e2-b318d83dc806 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.260117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.280571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.281250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.281537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.281814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.282647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:33.282959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.284791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b241a50-14b7-446c-85d7-119aa8f136df None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.301643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 380/754] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:33.301643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.301643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.301643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.311359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.312343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.312578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.312844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.315164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:33.316374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:33.325081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.326892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:33.345795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:33.346695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:33.348504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:33.348504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:33.348504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:33.348504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:33.348504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 375/755] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:33.348504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.352586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.397643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 381/756] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:33.398826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.458472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d30932-af54-469b-8118-c61e8044ce30 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.495368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403baced-5997-4184-9333-e00cce29c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.496326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403baced-5997-4184-9333-e00cce29c13c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.496854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403baced-5997-4184-9333-e00cce29c13c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.497297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403baced-5997-4184-9333-e00cce29c13c None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.498424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403baced-5997-4184-9333-e00cce29c13c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:33.498866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403baced-5997-4184-9333-e00cce29c13c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.500663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403baced-5997-4184-9333-e00cce29c13c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.505938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d6afa-8998-4db7-831d-34f629dc7a44 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.514396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.521157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 376/757] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:33.522505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403baced-5997-4184-9333-e00cce29c13c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.549125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.549795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.550094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.550347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.551214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d298476d65ba4329b5aea924e7fd5f46) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:33.551524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.553075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.570365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 382/758] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/role_assignments?user.id=d298476d65ba4329b5aea924e7fd5f46&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:33.570365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.604535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.665728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403baced-5997-4184-9333-e00cce29c13c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.697358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1b41d-ee68-4287-9a7d-9e3bea47e9c2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.716303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.717493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.717849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.718196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.719030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:33.719415 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.721576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.738049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 377/759] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:33.738373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.739088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.739835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.740329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.740785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.741770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.744289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:33.764730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:33.765705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:33.766562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:33.773490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 383/760] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:33.773490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.808032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.858660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab4fe6-792e-4d52-97ca-bb4a139cf0f1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.875401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25aaac-3cb6-4de4-8b89-f740892feee5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:33.892189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.903066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.904115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.904777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.905059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.912919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:33.913743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:33.914027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:33.914303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:33.921546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.923115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:33.938105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:33.939372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:33.940476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 384/761] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:33.941191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:33.995603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:33.997836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.044574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.056047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d4f7d-eb75-4701-abb6-c1be4a0b4331 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.108084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.109278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.109765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.110049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.110815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:34.111158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.112594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 378/762] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:34.113462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.117273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.124114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 385/763] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 22:25:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:34.125380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.140529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.219716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936195-87e6-4a8a-831d-4b69c6a0ef8b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.254950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604650c-ee0f-414c-993c-e361ac47a974 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.263018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.264190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.265040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.265455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.267022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:34.267576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.269405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.291013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 379/764] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:34.291013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.297118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.298769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.299275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.299741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.314047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.316779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:34.341602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:34.342525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:34.343429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:34.343429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:34.343429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:34.343429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:34.350879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 386/765] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:34.350879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.362136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.388563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.414394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950c9c-e326-46d5-9f16-7246a98e3eca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.459980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.461640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.462117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.462583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.463355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ee27-3cf4-4780-b01b-1851fa0e541f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.463721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:34.464244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.466940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.473341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 380/766] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:34.474939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.509644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.510496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.510778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.511095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d1ef9948ee7a4b2b86b823b7e97a7d77/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.513201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=d1ef9948ee7a4b2b86b823b7e97a7d77, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.514676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.539031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 387/767] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:34 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d1ef9948ee7a4b2b86b823b7e97a7d77/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:34.539031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.624515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.661921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2122177-2f94-4cf3-8487-23aeeba2d9cf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.673171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7a79-e503-4353-a77c-93d61c8dfb4f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.705364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.706070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.706350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.706624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.707593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] RBAC: Adding query filter params (interface=public, service_id=fc267730d2904278b00ef307d97fb2b2, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:34.707935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.709725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.719769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 388/768] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/endpoints?service_id=fc267730d2904278b00ef307d97fb2b2&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:34.724906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.766757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.767527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.767808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.768088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.772503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:34.772868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.774321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.798034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 381/769] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:34.806233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:34.820649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.875096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dce3f-61b2-42b9-a66a-354be1b4b629 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.926016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969f9e6-877b-4b8a-8ad4-397eebdbad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.927183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f9e6-877b-4b8a-8ad4-397eebdbad45 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.927656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f9e6-877b-4b8a-8ad4-397eebdbad45 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.928232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f9e6-877b-4b8a-8ad4-397eebdbad45 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.929210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969f9e6-877b-4b8a-8ad4-397eebdbad45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:34.930794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969f9e6-877b-4b8a-8ad4-397eebdbad45 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:34.932457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:34.935819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f47f30-0f92-4962-a399-4367cfdd4b16 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:34.951199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 389/770] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:34.952940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34bd5-c495-41bc-9304-f6e4a43ee17b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.953238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34bd5-c495-41bc-9304-f6e4a43ee17b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.953560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34bd5-c495-41bc-9304-f6e4a43ee17b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.955432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 390/771] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:34.967614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.967894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.968171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:34.983706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:34.984896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:34.985398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:34.986253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.005428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:35.007303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:35.009025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:35.013749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:35.047028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:35.048221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 382/772] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:35.049287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:35.116568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 391/773] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:25:35.145018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:35.179423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:35.232037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d076-787e-429a-a90d-366189d2cb22 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:35.295552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:35.296229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.296486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.296755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.297547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:35.297886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:35.299392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:35.304939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b23900-d78a-4aca-86f2-d4da6963f4df None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:35.318133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 383/774] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:35.324058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:35.400314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:35.429024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65671bea-98fe-44f5-a0d2-18775b4ca7f5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:35.439699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:35.440531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.440807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.441073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] PATH_INFO: `/v3/services/network` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.441739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:35.443162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:35.456710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:35.464267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:35.464929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.465204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.465473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.466310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=fc8fa6b53b194df0831995429213db40) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:35.466618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:35.468095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6e25b7b3-d77d-4ef6-bb7c-3daca6b86816 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:35.470577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:35.471563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:35.472371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:35.474391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 384/775] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/role_assignments?user.id=fc8fa6b53b194df0831995429213db40&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:35.484148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 392/776] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/services/network => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:35.490945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:35.676820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42297-4d32-447c-9b39-f67e2de57c2d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:35.697445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf96b4-b661-4278-989a-fb091c64f66d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.697793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf96b4-b661-4278-989a-fb091c64f66d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.697995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf96b4-b661-4278-989a-fb091c64f66d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.699653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 393/777] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:35.705535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.705821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.706081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.722103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:35.723177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.723655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.724121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.725018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] RBAC: Adding query filter params (name=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:35.725316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:35.725759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:35.726509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:35.727576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:35.742401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 385/778] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:35.743908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:35.826447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:35.859073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 394/779] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:25:35.899390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:35.900517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6fa08-6f44-4213-acf1-1198d72c1d47 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:35.969119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:35.969861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:35.970139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:35.970406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:35.971140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:35.971444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:35.972835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:35.985669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 386/780] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:35.992123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:36.039669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41987427-6fd5-4a17-b341-5e8b0457fce2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:36.066034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:36.077195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:36.078007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:36.078313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:36.078583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:36.096361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:36.104113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:36.105001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:36.105814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 395/781] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:36.115441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:36.321972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063753-cf37-48de-a4d2-f2f2b37d9b11 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:36.344216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:36.360134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:36.360876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:36.361157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:36.361431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:36.362224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] RBAC: Adding query filter params (interface=public, service_id=b502602cf495481ca4a616cd95302aa4, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:36.362537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:36.364379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:36.374184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 387/782] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:25:35 2022] GET /identity/v3/endpoints?service_id=b502602cf495481ca4a616cd95302aa4&interface=public®ion_id=RegionOne => generated 194 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:36.379621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:36.402947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb841d-2737-48f3-a6a8-a1a6032ec211 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:36.485319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25fb74-40ad-46bb-b2ac-b0bfde8959fc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:36.524882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:36.525569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:36.525843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:36.526107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:36.526791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:36.528207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:36.531697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:36.532429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:36.532712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:36.532987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:36.533759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:36.534438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 388/783] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:25:36 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:36.534542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:36.535962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:36.553648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 396/784] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:36.559149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:36.615550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:36.664617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d0ff3-eaf4-40ad-91c8-7cb64dbfca5a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:36.700440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:36.701271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:36.701546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:36.701812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:36.713262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:36.714767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:36.733904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:36.734843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:36.735803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:36.735803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:36.735803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:36.735803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:36.735803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 389/785] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:36.744451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:36.803299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:36.862552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433255-3ce8-4437-89a5-067e502ad9af None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:36.908762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:36.910140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:36.910620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:36.911140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:36.912078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:36.912581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:36.914209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78316-849d-460c-81e5-ece13512becd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:36.927645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 397/786] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:36.936427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.041896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.045657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d35c4f-e7d3-4b4b-af8d-f324ca1d5756 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.080612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938b49-9165-4524-b6b1-0caebe4cbea4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.080809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.081497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.081731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938b49-9165-4524-b6b1-0caebe4cbea4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.081832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.082068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.082508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938b49-9165-4524-b6b1-0caebe4cbea4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.084242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 398/787] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:37.089621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.089902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.090029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:37.090178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.092035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:37.106805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:37.107836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:37.108775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:37.109303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 390/788] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:37.116863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.124798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:37.126109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:37.221777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 399/789] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:37.265761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.271200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca258e4-95a8-4ca4-8c99-958242be474c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.306805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.307523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.307801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.308070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.309026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:37.309329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:37.310824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:37.329830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 391/790] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:37.335433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.350460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.355410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.462977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b24a9f-55ab-4184-b752-b06bc436faa9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.475652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081b7c-70ca-4b2d-96ee-ae44936ac06c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.503037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.504270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.504859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.505340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.511716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0dfd-7649-4450-bfc5-af62589e768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.512539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0dfd-7649-4450-bfc5-af62589e768c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.512817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0dfd-7649-4450-bfc5-af62589e768c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.513088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0dfd-7649-4450-bfc5-af62589e768c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.517930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:37.519677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:37.524391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0dfd-7649-4450-bfc5-af62589e768c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-200f0dfd-7649-4450-bfc5-af62589e768c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:37.532527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:37.533465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:37.534641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:37.539080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 400/791] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:37.540423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cc9b0-8811-4a04-9b7c-b6cbe8085959 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.540710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cc9b0-8811-4a04-9b7c-b6cbe8085959 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.540987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cc9b0-8811-4a04-9b7c-b6cbe8085959 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.542558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 401/792] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-25b1a616-354b-4de2-81a0-1c50a80c62b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:37.543274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:37.544257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:37.545118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:37.545118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:37.545118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:37.545118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:37.545331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cc9b0-8811-4a04-9b7c-b6cbe8085959 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.547842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 392/793] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:37.549351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.549837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.550312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.569371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:37.570929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:37.638498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.646203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 393/794] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:37.647552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.659890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.668281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cc9b0-8811-4a04-9b7c-b6cbe8085959 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.709119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.709801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.710074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.710354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.711167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:37.711476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:37.713166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:37.723834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 402/795] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:37.725488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.756778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ca332-6c6f-4eca-ac95-5b40c31f87a0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.794820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.796206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.796711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.797453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.799310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:37.799850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:37.801443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:37.817566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 394/796] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:37.818894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.829874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c2fd-eb71-4940-b5b1-568094f73f51 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.866619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.867520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.867794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.868106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:37.868764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:37.870897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:37.884410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:37.885361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:25:37.886189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:37.890429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 403/797] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:37.896465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.896615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:37.923739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:37.954841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99087-7db0-49b0-9aa0-8625ffd03024 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:37.990284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:37.991534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:37.992029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:37.992503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.005265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.007482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.023069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab126-b69e-4c23-80fc-b6158691c8bd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:38.029316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:38.030196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:38.031088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:38.031088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:38.031088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:38.031088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:38.031456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 395/798] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:38.032316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.060135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.060951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.061234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.061506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.068526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.069993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-172af570-0392-4a4e-82b6-e922b3c66476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:38.084631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:38.085519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 404/799] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0a26-6d21-41ba-9dcf-5ca411e12fca None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.095716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0a26-6d21-41ba-9dcf-5ca411e12fca None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.096426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e0a26-6d21-41ba-9dcf-5ca411e12fca None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.096426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 405/800] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:38.096426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0a26-6d21-41ba-9dcf-5ca411e12fca None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.145530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9def2-d820-4d9c-aa73-2d687fc7e4c2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.155712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:38.180628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.181382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.181665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.181945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.182651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:38.182982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.184512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.185281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:38.189539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 396/801] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:38.190317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.211186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e0a26-6d21-41ba-9dcf-5ca411e12fca None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.247732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.248407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.248688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.248967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.249698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:38.250007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.251594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ce69-ec83-4429-8e84-405b1837d2b4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.263462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 406/802] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:38.264414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.264701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.264975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.281980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:38.283210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:38.303156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e8ce-07da-4db9-981f-18f723d552ef None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.339530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.340279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.340586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.340858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.341641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:38.342057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.343427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.352886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 407/803] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:38.356696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 397/804] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:38.357515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.363929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.401031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:38.440800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:38.472023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a5b3-5196-41a1-b7b6-81967dc35e39 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.472641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35082-663f-40cb-94c5-c80df82e4e85 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.509503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.510191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.510749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.511064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.511342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.511554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.512148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.512569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.513415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:38.513912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.515463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.519028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.520484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.525962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 408/805] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:38.527042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:38.536198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:38.537160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 398/806] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:38.538626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.637214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881d19b-4af3-4f8e-82f7-073635a49c24 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.644083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:38.651732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59c75b-cb7f-4f4a-9d43-399438175bf5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.676421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.677337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.677619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.677893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d298476d65ba4329b5aea924e7fd5f46/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.679928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=d298476d65ba4329b5aea924e7fd5f46, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.681465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.683817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:38.688304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.689159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.689442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.689711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.697771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 409/807] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:38 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d298476d65ba4329b5aea924e7fd5f46/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:38.698519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.710732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:38.718835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:38.719894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:38.720732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 399/808] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:38.721460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.839527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402dde-c3b6-49de-990c-2f2ceaccc1e6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.852812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6650-eea5-446f-8d53-395c0ad6b909 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:38.890109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0577e6-9006-48ef-90c4-9d0f7d0780c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.891097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0577e6-9006-48ef-90c4-9d0f7d0780c0 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.891550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0577e6-9006-48ef-90c4-9d0f7d0780c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.891828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0577e6-9006-48ef-90c4-9d0f7d0780c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.892589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0577e6-9006-48ef-90c4-9d0f7d0780c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.893937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:38.894057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0577e6-9006-48ef-90c4-9d0f7d0780c0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.894844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.895881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.895881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.896524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:38.896923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:38.898570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:38.919787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 400/809] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:38.920870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.923840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 410/810] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:25:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:38.925446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234834-5d32-44ef-8e07-19024fd8ba94 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:38.925864 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234834-5d32-44ef-8e07-19024fd8ba94 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:38.926268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81234834-5d32-44ef-8e07-19024fd8ba94 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:38.928916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 411/811] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:38.930061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81234834-5d32-44ef-8e07-19024fd8ba94 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:38.951424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.010830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.068292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07e54d-215c-4679-86b1-cb59a4ddc540 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.078357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81234834-5d32-44ef-8e07-19024fd8ba94 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.107115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.108481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.108911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.109568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.110367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:39.110831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.112419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9734f1-5237-4721-ab4b-c6b3885dd3b8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.117948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.118626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.118917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.119215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.121870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 401/812] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:39.124546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.125047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.125728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.153308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:39.155286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:39.195919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.197525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.246865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 402/813] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:39.247966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.252466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.252619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.311809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 412/814] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:39.313233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.366495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69c158-4859-4a91-8290-8e59db9eceda None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.402039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.402411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.402782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.403190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.414466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.416140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.434406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cadab-c16e-49bc-97cb-dd9698a63c34 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:39.434697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:39.435713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:39.436592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:39.436592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:39.436592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:39.436592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:39.437018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 403/815] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:39.438122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.475486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.476602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.477024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.477460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] PATH_INFO: `/v3/services/network` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.478319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.479983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:39.493515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:39.494582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:25:39.495468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:39.496546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.498650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 413/816] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:39.499823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.514057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.543632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f36697-54ab-4162-8a2b-a4d742324ce1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.579044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.580119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.580401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.580673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.591419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.592957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.609314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e108f-797d-4d71-9df9-1f23f64dec5b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:39.611256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:39.612114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:39.613408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:39.613408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:39.613408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:39.613408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:39.613408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 404/817] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:39.613840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.648547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.649602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.650157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.650625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.651641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:39.652140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.653837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.667470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 414/818] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:39.668669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.721761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb752f2-9f2a-4da6-b8de-30687ec6d2e7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.731648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.744598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.757340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.758020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.758301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.758576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.759331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] RBAC: Adding query filter params (name=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:39.759640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.761039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.766302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 405/819] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:39.767167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.783181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02da0d-f453-4987-944a-84e724df295b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.821310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.822346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.822844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.823339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.824357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:39.824976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.826564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.839895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 415/820] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:39.841160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.871961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b9677-0613-407d-8c16-39948a7c459c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.908273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.909372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.909653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:39.909925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:39.917807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:39.919367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:39.935750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:39.936802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 406/821] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:39.938398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:39.956123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1b98a-e7f2-4ac5-a7bb-64fe86950510 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:39.979274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.990532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:39.998828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:39.999546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:39.999825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.000120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.001012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] RBAC: Adding query filter params (type=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:40.001319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.003410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.009593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 416/822] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:40.010656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.085936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df1a3-eedc-4f7c-ae96-a11899a2a9c7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.131240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.132960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.133600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.134166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.144447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.145785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb220a2-4a38-47a2-85cc-79fbf2cfa74d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.146420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:40.162406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:40.163316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:40.164521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 407/823] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:40.165286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.198493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.199330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.199920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.200260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.201908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:40.202290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.204289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.231260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 417/824] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 22:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:40.232177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.273502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:40.283963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f954d-ca63-4450-b4bd-8d1ed4a77073 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.303424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:40.320235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.320910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.321190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.321462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.322210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.323653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.355018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 408/825] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:25:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:40.355018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.373112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4806db4-0e5c-4706-a466-54e28fce88ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.487022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e220a5-f321-45db-846c-7e537080cdc5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.491846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.492599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.492883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.493153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.493959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:40.494266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.495749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.527942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 418/826] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:40.528541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.529127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.529407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.529683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.534715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.549936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.551467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.555138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:40.577412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:40.578764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:40.580858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:40.580858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:40.580858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:40.580858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:40.580858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 409/827] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:40.584227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.686786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4d2f-98d7-4736-b982-76310072da52 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.698008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:40.731013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.731689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.731962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.732229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.733068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d1ef9948ee7a4b2b86b823b7e97a7d77) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:40.733371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.734983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a89c7-4834-41b6-a368-5699a15adf6f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.742365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 419/828] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:40 2022] GET /identity/v3/role_assignments?user.id=d1ef9948ee7a4b2b86b823b7e97a7d77&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:40.743666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95295123-4886-46a8-b286-bfbac30d28d2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.793772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.794488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.794767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.795062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.795817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:40.796123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.797651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:40.804030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d0c3-fcdd-4247-a17f-421160998d88 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.804351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d0c3-fcdd-4247-a17f-421160998d88 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.804594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d0c3-fcdd-4247-a17f-421160998d88 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.810170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 420/829] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:40.812023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.812306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.812527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 410/830] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:40.812686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.818071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:40.892223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:40.946351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39401ab-82ef-49ce-b0ff-02b79158be49 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:40.970064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:40.971280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:40.987720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:40.988548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:40.988830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:40.989087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:40.997281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:40.998683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:41.014653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:41.016266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:41.017594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 411/831] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:41.021873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.055834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 421/832] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:41.079018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.131658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481896d1-3eee-4e28-aebe-cbc74b57c5c2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.162302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:41.174242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.175246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.175627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.176002 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.176896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:41.177307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.178857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.190566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1945-5c9e-4938-bc18-877e39672678 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.191788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 412/833] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:41.192155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:41.199345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.232549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad3ca-70cb-44b8-90a3-72d62d9523d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.234423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad3ca-70cb-44b8-90a3-72d62d9523d3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.235248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad3ca-70cb-44b8-90a3-72d62d9523d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.235723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad3ca-70cb-44b8-90a3-72d62d9523d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.250059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad3ca-70cb-44b8-90a3-72d62d9523d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9fdad3ca-70cb-44b8-90a3-72d62d9523d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:41.260881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:41.261789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:25:41.262642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:41.264663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 422/834] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:41.265700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25632779-5955-4d70-b841-2e6dd75f146b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.265986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25632779-5955-4d70-b841-2e6dd75f146b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.266265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25632779-5955-4d70-b841-2e6dd75f146b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.267577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 423/835] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:41.272950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.273233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.273507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.290390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:41.291624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:41.318568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0b11-f2f5-4324-a48b-4f86bce67f34 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.354584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.355556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.355824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.356125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/fc8fa6b53b194df0831995429213db40/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.361124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 424/836] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:41.362062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.387415 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=fc8fa6b53b194df0831995429213db40, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.388965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.404571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 413/837] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:41 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/fc8fa6b53b194df0831995429213db40/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:41.405641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.451771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:41.482100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:41.494704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17432-f7a7-43f3-9dbe-12cc54e5b8b8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.537071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.538533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.539028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.539498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.540556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:41.541049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.542692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.557479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7783-fca2-4fc2-8f16-c4b393570734 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.558504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 425/838] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:41.560205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.598144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.599285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.599567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.599872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.600705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.602400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:41.615588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:41.616615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:41.617479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 414/839] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:41.623874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.678347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6eeb4-3c37-45ab-b0b1-e63ee4f71cb7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.713974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.714784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.715089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.715360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.726877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.729022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.744473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:41.747547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:41.748397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:41.749267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:41.749267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:41.749267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:41.749267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:41.751881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 426/840] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:41.755958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.760150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3a2b-722f-4458-a499-7a35f7439cd7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.768187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:41.802826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.803447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.803858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.804131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.805604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:41.805930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.807416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.812895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 415/841] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:41.818053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.886200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b5e9-b24a-4726-baba-cccb540f405e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.922364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.922960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.923273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.923547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.924283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:41.924599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.925971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.943265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 427/842] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:41.944987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:41.945854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604bf4f-2ca6-48b6-bf40-87ec05eec5de None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:41.982167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:41.983348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:41.983828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:41.984351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:41.985278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:41.985807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:41.987495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:41.993847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 416/843] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:42.018148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:42.058266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a83b-78f8-4074-8a0d-539bb19a4575 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:42.096418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:42.097249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.097531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.097804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:42.106665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:42.108208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:42.124084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:42.125172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:42.126297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 428/844] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:25:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:42.131553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:42.153883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:42.238530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9abd-006a-4334-b7d4-756c8b5f46a2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:42.271416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:42.272100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.272386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.272664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:42.273507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:42.273820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:42.275317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:42.293344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 417/845] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 22:25:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:42.299156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:42.402632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46953-d26b-46a7-a178-7deed3057bb7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:42.433215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:42.437311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:42.438235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.438699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.439180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:42.507619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:42.509067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:42.612316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 429/846] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:42.618540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:42.699014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:42.723222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4262b-8314-4e33-9876-2d0c04ad8bc2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:42.757823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:42.758978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.759482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.759946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:42.770247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:42.772066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:42.790466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:42.791401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:42.792281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:42.792281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:42.792281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:42.792281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:42.792281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 418/847] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:42.798797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:42.842024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:42.899738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcfd8d-ef78-4aeb-91ea-73f24caaa2eb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:42.934443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:42.935139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.935417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.935689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:42.936405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:42.936708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:42.938175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679108-cd7d-44c3-ad8e-7e0a0a76eac0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:42.950224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 430/848] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:42.956091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:42.979217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b99006-6790-48bd-962e-246095f7176e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.979509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b99006-6790-48bd-962e-246095f7176e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.979766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b99006-6790-48bd-962e-246095f7176e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:42.981370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 431/849] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:42.986397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:42.986685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:42.986960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.004403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:43.005579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:43.075555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb02a0-1727-4689-b6a7-655c61741f88 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.079071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 432/850] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:25:43.097018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.114375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:43.121698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:43.126822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.130658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.131051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.131333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.141026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.142517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:43.158774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:43.159726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:43.160626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:43.165292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 419/851] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:43.166299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.225947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e582f-4f1a-46b5-8b6b-152d0571e51d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.262153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.263411 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.263895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.264381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.265306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.266889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.273850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b686acc-b27f-4478-ad87-d7b09deaac74 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:43.280467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:43.281402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:43.282211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:43.285445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 433/852] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:43.291253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.315167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.315847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.316130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.316407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.317199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:43.317510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.318956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.336743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 420/853] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:43.337637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.380801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:43.389295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:43.402642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78706d0-90de-426e-a411-23d167fb7fb7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.439039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.440125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.440525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.440897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.441865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:43.442278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.444321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.445682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0d98d-084c-4aa2-9889-f480b499433a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.451021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 434/854] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:43.456231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.492661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.494348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.494877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.495581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.497326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d298476d65ba4329b5aea924e7fd5f46) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:43.497844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.500773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721360c8-9f06-4dd9-805b-7bc2c15aebb4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.508929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 421/855] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/role_assignments?user.id=d298476d65ba4329b5aea924e7fd5f46&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:43.510760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a6912-a136-49df-8e8b-dd88b4657daa None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.511396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a6912-a136-49df-8e8b-dd88b4657daa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.512264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a6912-a136-49df-8e8b-dd88b4657daa None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.514592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 422/856] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:43.521089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.521404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.521653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.551524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:43.553228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:43.583362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ca674-6269-4623-bdbe-76347f54029d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.632242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.634415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.635242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.635747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.636926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:43.637448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.644731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 423/857] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:43.645238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.649879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 435/858] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:43.665644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.715890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:43.778832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf899d-68a0-4bd5-9ad1-fb5a245442ec None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.816851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.817676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.817962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.818237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.829085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:43.836944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:43.837874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:43.838721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 424/859] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:43.844359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:43.856421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:43.948806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d30b6d-9a2b-4c19-a57b-cf234f8fae6c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:43.983463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:43.984208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:43.984494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:43.984768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:43.985529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:43.985838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:43.987241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bf550-63d5-4e06-a651-c10fafe13a48 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:43.996100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 436/860] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:44.001704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:44.104547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509039cf-69eb-42c4-80ae-db924d834d1b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:44.106060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:44.111282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c2d3-5afe-4887-8cad-eccfc2e02db8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.111575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c2d3-5afe-4887-8cad-eccfc2e02db8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.111853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c2d3-5afe-4887-8cad-eccfc2e02db8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.113994 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 437/861] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:44.119165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.119460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.119739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.138023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:44.139355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:44.146261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:44.147106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.147800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.148077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.161772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:44.163561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:44.185939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:44.186964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:44.187880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:44.187880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:44.187880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:44.187880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:44.188096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 425/862] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:44.193353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:44.215412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:44.219093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 438/863] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:25:44.237690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:44.293794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1575d-0515-4370-bbbd-5361eb2b8a00 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:44.328166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:44.328846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.329130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.329402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.330134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:44.330444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:44.331865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:44.338044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cd1b0-56d7-4f6f-b901-67c4a977f999 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:44.348266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 426/864] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:44.349368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:44.365523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:44.382325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:44.383390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.383915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.384381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.385498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:44.387208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:44.405784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 439/865] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:25:44 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:25:44.472328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a75bce-25ea-4add-902c-84bbcc51e278 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:44.519415 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:44.520628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.521103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.521598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.532073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:44.534363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:44.551337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:44.552341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:44.553252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:44.556276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 427/866] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:25:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:44.564205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:44.631031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:44.677679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687327e4-f8ab-4146-9f14-2b520004979f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:44.715075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:44.716124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.716667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.717115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.718647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:44.719200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:44.720835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:44.739680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 440/867] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 22:25:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:44.745572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:44.817408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:44.852232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f401-5259-420f-a9d8-0ac682561d58 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:44.894005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:44.894589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:44.894863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:44.895161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:44.962735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:44.964232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:45.031352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:45.062239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 428/868] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:44 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:45.067514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:45.167736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4c214-32fb-4483-823c-f1b1a5dc5bf9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:45.187187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:45.204958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:45.205772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.206043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.206306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.216972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:45.218587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:45.237034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:45.237991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:45.239317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:45.239317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:45.239317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:45.239317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:45.239317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 441/869] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:45.244190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:45.350134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c08747-98c0-4c0c-8d4b-03575e3f45ef None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:45.388524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:45.389273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.389625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.390030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.390825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:45.391254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:45.392695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:45.405055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 429/870] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:45.410670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:45.510157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623acb32-0968-4b29-a503-8a00fdb29dff None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:45.545601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:45.546545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.546815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.547107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.554231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:45.555710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-64f7d80a-764a-40c9-8d5c-0bf619b33974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:45.569647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:45.570534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:45.571416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:45.575234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 442/871] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:45.580132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:45.611294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:45.685331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ac40-75c6-4994-8455-f577113fe114 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:45.720483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:45.720857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5ad40-c9f7-4917-8ca2-bb659d45cad0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.721288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.721468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.721699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.722124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5ad40-c9f7-4917-8ca2-bb659d45cad0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.722495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:45.722778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5ad40-c9f7-4917-8ca2-bb659d45cad0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.722886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:45.724388 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:45.724878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 443/872] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:45.729953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3f180-ac79-49fa-93b2-cedc927e4db4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.730482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3f180-ac79-49fa-93b2-cedc927e4db4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.730964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3f180-ac79-49fa-93b2-cedc927e4db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.739034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 430/873] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:45.742844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:45.754065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c0d3f180-ac79-49fa-93b2-cedc927e4db4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:45.755303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c0d3f180-ac79-49fa-93b2-cedc927e4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:45.783329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:45.831044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 444/874] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:25:45.831044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae92b33-2680-4baf-a21c-daf6d69b8ffd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.831044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae92b33-2680-4baf-a21c-daf6d69b8ffd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.831387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae92b33-2680-4baf-a21c-daf6d69b8ffd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.836774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 445/875] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:45.837761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.838041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.838321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.853638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:45.855809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:45.857365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:45.864515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d506ee-2d5e-4056-ade2-771fe62f7a94 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:45.899376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:45.900035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:45.900318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:45.900594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:45.901549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=fc8fa6b53b194df0831995429213db40) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:45.901862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:45.903325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:45.919024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 431/876] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:45 2022] GET /identity/v3/role_assignments?user.id=fc8fa6b53b194df0831995429213db40&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:45.919024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:45.947205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 446/877] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:45.969939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:46.055458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28043a5-ced9-41d7-a29e-2652194418a6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:46.072442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:46.089303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4769b58-e8e4-49a7-8fe2-24985877058a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:46.102507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:46.103366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.103647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.103922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.105533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:46.106927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:46.119543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:46.120537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:46.121338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 432/878] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:46.127958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:46.135168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:46.135901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.136187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.136456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.137201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:46.138590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:46.150814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:46.158125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 447/879] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:25:45 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:25:46.255985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6c5c-1e38-4b9d-a093-a6a8106d7b37 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:46.299181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:46.299871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.300151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.300424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.301139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:46.301448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:46.302867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a22dc-9bcc-4d4f-8a03-36b56376309c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:46.308809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 433/880] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:46.314669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:46.432862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff702ef-1a4b-4e3c-aa0e-486342ac0d45 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:46.467336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:46.468546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.469022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.469512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.470417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:46.470916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:46.472504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52a71-795b-4a85-a372-9ac491007476 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:46.477800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 448/881] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:46.597444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05f06-9b2d-4aff-960f-5ee6c8548317 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.597645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05f06-9b2d-4aff-960f-5ee6c8548317 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.597919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05f06-9b2d-4aff-960f-5ee6c8548317 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.599623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 434/882] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:46.605528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.606150 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.606704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.624784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:46.626387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:46.637634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:46.701778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 449/883] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:46.725626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05f06-9b2d-4aff-960f-5ee6c8548317 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:46.809120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:46.832318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05f06-9b2d-4aff-960f-5ee6c8548317 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:46.866972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:46.867791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:46.868066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:46.868343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:46.869001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:46.870383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:46.883515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:46.884819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:46.885715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:46.890067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 435/884] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:46.891535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:46.997308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca35891-d3d2-4ebe-b6e6-7ad9f0866a68 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:47.032774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:47.033447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:47.033731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:47.034008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:47.034719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:47.035057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:47.036447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:47.041744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 450/885] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:47.047328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:47.147518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56326105-4f75-4daf-b14b-7dda98d27087 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:47.181607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:47.182277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:47.182557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:47.182827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:47.183595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:47.183898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:47.185271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:47.195098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 436/886] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:47.196721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:47.208002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:47.300751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894bc52-7c61-416b-a3b2-614324ad06c3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:47.334563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:47.335276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:47.335561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:47.335833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:47.336624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] RBAC: Adding query filter params (interface=public, service_id=097e2d3d5b354583b80a082f5c785f1d, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:47.336932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:47.338316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16292f-f2dd-4885-8950-743653828486 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:47.348164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 451/887] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:25:47 2022] GET /identity/v3/endpoints?service_id=097e2d3d5b354583b80a082f5c785f1d&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:47.349586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:47.359880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:47.455177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032985a-015b-4fa1-9d32-69a2ee0700c7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:47.488467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457a584-65d5-49b2-9e24-80e54d4d7cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:47.489182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457a584-65d5-49b2-9e24-80e54d4d7cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:47.489470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457a584-65d5-49b2-9e24-80e54d4d7cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:47.489737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457a584-65d5-49b2-9e24-80e54d4d7cf8 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:47.490419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457a584-65d5-49b2-9e24-80e54d4d7cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:47.491824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457a584-65d5-49b2-9e24-80e54d4d7cf8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:47.501775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 437/888] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:25:47 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:25:48.182178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9033216-f13c-4e19-8d2c-131077111d98 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.183277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9033216-f13c-4e19-8d2c-131077111d98 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.183760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9033216-f13c-4e19-8d2c-131077111d98 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.185593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 452/889] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:48.191386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fa2c-f0a5-46a0-8a56-33eba007b562 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.193556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fa2c-f0a5-46a0-8a56-33eba007b562 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.194043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fa2c-f0a5-46a0-8a56-33eba007b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.212660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-27a5fa2c-f0a5-46a0-8a56-33eba007b562 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:48.214200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-27a5fa2c-f0a5-46a0-8a56-33eba007b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:48.282451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.287717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 438/890] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:48.299732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc8e1-30a1-4bf8-a908-76447e4eb376 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.300314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc8e1-30a1-4bf8-a908-76447e4eb376 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.300785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbc8e1-30a1-4bf8-a908-76447e4eb376 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.302657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 453/891] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:48.308605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.308885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.309156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.313370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc8e1-30a1-4bf8-a908-76447e4eb376 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.328979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:48.330460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:48.391440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.424324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbc8e1-30a1-4bf8-a908-76447e4eb376 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:48.431097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 439/892] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:48.450552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.469761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:48.470686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.471055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.471395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.485458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:48.502013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:48.503030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:25:48.503862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:48.507305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 454/893] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:48.509803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.580597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e6b0-4de2-46f8-a501-ea8015cdb437 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:48.614430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.622318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:48.623549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.623852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.624127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.624789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:48.626189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:48.628616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2434802-9805-4c10-9044-29e4f660afa4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-17fc13fc-1e13-4c18-a08e-17326b7486d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:48.639469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:48.640602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:48.641450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 440/894] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:48.642536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b416-2d76-4fbb-9995-818737e30ea1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.642805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b416-2d76-4fbb-9995-818737e30ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.643101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721b416-2d76-4fbb-9995-818737e30ea1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.644567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 441/895] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:48.646468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721b416-2d76-4fbb-9995-818737e30ea1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.670108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.675710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:48.676572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.676845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.677117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.677873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:48.678177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:48.679587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb328511-6649-4c10-a99a-13782517ce99 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:48.692257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 455/896] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:48.692257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.692257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.692257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.707859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:48.709111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:48.766244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721b416-2d76-4fbb-9995-818737e30ea1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:48.778831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 456/897] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:48.779670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.809740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:48.810495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.810684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.811065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.811859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:48.812033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:48.813395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:48.822694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 442/898] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:48.822694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.883842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.887788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba01d6-9531-4856-bb33-c74ec43310d2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:48.911618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.924722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:48.925534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.925811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.926086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.930201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f89f6b-7c1c-4f96-a6be-04e602c79af5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:48.936582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:48.938260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:48.957421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:48.958364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:48.959775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:48.959775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:48.959775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:48.959775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:48.959775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 457/899] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:48.959775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:48.974428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:48.975255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.975647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.975911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.976736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:48.978115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:48.993570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 443/900] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:25:48 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:48.994225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.107937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce671d-0648-4d58-9080-611effa47653 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.119779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcd18d-af1a-4fc1-9207-837ddca2f0ff None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.141342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.153827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.154492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.154812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.155591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.156102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:49.156425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.158127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.165803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 458/901] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:49.171841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.178857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.179634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.179980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.180316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.181117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:49.181490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.182940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.199067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 444/902] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:49.203980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.224050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.285891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de55e-1664-4e3e-9341-9286353ca0a8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.306235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dac67-1b14-450a-b137-4069f1c67c2e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.323864 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.324767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.325141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.325509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.326435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] RBAC: Adding query filter params (interface=public, service_id=4a3c8f22907347eba3a544a3c2bdb285, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:49.326976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.328493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.334717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 459/903] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/endpoints?service_id=4a3c8f22907347eba3a544a3c2bdb285&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:49.340669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.341510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.342709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.343162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.343580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.351837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.353511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:49.369241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:49.370361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:49.371529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:49.373895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 445/904] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:49.383683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.429245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.459075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d59b15-df7a-472e-9736-c8f071970769 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.462510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.507768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a46f-268e-4f6c-bb75-7a31bc50c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.509006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a46f-268e-4f6c-bb75-7a31bc50c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.509734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a46f-268e-4f6c-bb75-7a31bc50c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.510143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a46f-268e-4f6c-bb75-7a31bc50c4c4 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.511519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a46f-268e-4f6c-bb75-7a31bc50c4c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.513473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a46f-268e-4f6c-bb75-7a31bc50c4c4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.519697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819fb8b-1175-44eb-8d57-bbb3c28daacd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.523386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 460/905] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:25:49.560351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.561076 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04479325-e0c1-468c-920f-4273d7ff317d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.561357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04479325-e0c1-468c-920f-4273d7ff317d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.561625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04479325-e0c1-468c-920f-4273d7ff317d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.562054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.562589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.563056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.564091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:49.564580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.566254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.567216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 461/906] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:49.568591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.568870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.569159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.587624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:49.588892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.592959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 446/907] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:49.600149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.675219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 462/908] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:49.699061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.701584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.712776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0adf8-1a09-40c0-b9c3-33d585261c55 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.750874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.751578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.751861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.752132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.802743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fd1f4-6214-427c-a2dd-a91cdf8b459f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.816085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.838626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.840122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.840348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.840809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.841265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.841596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.842332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.844208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:49.861190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:49.862173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:25:49.862964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:49.871006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 463/909] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:49.872708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.945285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.956902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 447/910] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:49.962841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.000290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb564b19-ab12-4c61-b980-9dacf37547aa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.051302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.052941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.053396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.053834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.054968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:50.055972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.058065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.069654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 464/911] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:50.070329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.080939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135667-9b0f-42fe-a25d-182a63793c0c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.098764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.128274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.129857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.130370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.131138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.144720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.147424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:50.175043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:50.175994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:50.177001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:50.177001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:50.177001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:50.177001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:50.179468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 448/912] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:50.186680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405615-3540-4385-86fc-6f7b92db7dfd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.186829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.227522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.228234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.228484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.228760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.229502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:50.229941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.232184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.238352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 465/913] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 22:25:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:50.243918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.245674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.305326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffab458-6483-4291-be04-433e99567a72 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.341556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.342796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.343328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.343433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.344258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.345205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:50.345725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.347416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.352785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe074e-cd12-43b0-9ad6-349fe9b3fb1a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.361073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 449/914] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:50.366881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.400106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.400900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.401267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.401631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.402465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.403969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.431085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 466/915] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:25:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:50.499976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0aee-731e-4c3e-993d-01b055e99f14 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.503326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.550745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.551605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.551883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.552152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.560111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.561607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:50.577169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:50.578157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:50.579296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 450/916] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:50.586295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.696662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7a0a0-818d-4196-9350-6cf4cfd9e236 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.733809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.734866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.735369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.735859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.736842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:50.737343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.738966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70dd50-e87a-40b0-ad8f-77442b3a2896 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.757959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 467/917] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:50.759686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.860120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17a4d9-8855-4861-b9a3-a547a79f28e7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.894231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.894885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.895198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.895598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.896420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] RBAC: Adding query filter params (role.id=8057b8f8d6da4311980d9d9de337a382, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=fc8fa6b53b194df0831995429213db40) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:50.896728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.898145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5bed2-06aa-42e0-8ac9-a1c12bd88209 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.903974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 451/918] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:50 2022] GET /identity/v3/role_assignments?user.id=fc8fa6b53b194df0831995429213db40&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=8057b8f8d6da4311980d9d9de337a382 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:51.079501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86c2f-c00b-492e-a8a1-90b1fd28331d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.079829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86c2f-c00b-492e-a8a1-90b1fd28331d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.080058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86c2f-c00b-492e-a8a1-90b1fd28331d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.081696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 468/919] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:51.086970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.087287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.087562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.104725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:51.105967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:51.123576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.174031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 452/920] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:51.197182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86c2f-c00b-492e-a8a1-90b1fd28331d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.206463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.301904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86c2f-c00b-492e-a8a1-90b1fd28331d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.336090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.336911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.337189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.337460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.338115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.339534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:51.351807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:51.352797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:51.353616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 469/921] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:51.359308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.460954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25e67-e2e2-4bf2-b524-e5bfcabd21c4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.495588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.496651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.497025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.497394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.498233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:51.498712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.500220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.505512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 453/922] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:51.512141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.581753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.613401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbe804-3987-4986-bda9-5f28fe712c82 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.648097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.648696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.648976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.649250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.649962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:51.650269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.651679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c977d-93e9-45b4-8402-70e95f69e4c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.657936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 470/923] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:51.663988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.674367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430e578-1f74-4b38-9642-96923c533ffc None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.674973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430e578-1f74-4b38-9642-96923c533ffc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.675480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430e578-1f74-4b38-9642-96923c533ffc None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.677437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 471/924] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:51.683229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.683860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.684347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.684821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.703957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:51.705679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:51.783407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186da757-8d4b-4c8f-80cd-13665a3176aa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.791089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 472/925] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:25:51.811851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.822359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.823071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.823358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.823633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.824423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] RBAC: Adding query filter params (interface=public, service_id=42b0402724d146d58cb1edff501c5891, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:51.824733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.826137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.831868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 454/926] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/endpoints?service_id=42b0402724d146d58cb1edff501c5891&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:51.840146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.884462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.924054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f19da-7677-42f9-9089-8c8b48927fe4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.959518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.960449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.960672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.960993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.961653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.963036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.971631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:51.979023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:51.980155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:51.980990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 473/927] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:51.983540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.984259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b10c8-1983-46e9-87e2-eb03cd23849a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:52.027213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:52.027889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.028167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.028438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.029153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:52.030535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:52.047499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 455/928] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/services => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:25:52.116871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155bd54-2552-4f8f-a5fa-6ebef35876d1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:52.147880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:52.157362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:52.158521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.159029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.159553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.160471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:52.160976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:52.162610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:52.168804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 474/929] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:52.175214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:52.279573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef8a83-0b4c-4d28-b318-e086d59afd70 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:52.315686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:52.316648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.317068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.317478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.318320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:52.318767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:52.320341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521023-a22d-4194-a61c-bb7b42ee319f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:52.326016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 456/930] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:52.331841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:52.435614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0b095-d91c-450f-81ed-2e0644d5d203 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:52.473615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f088353-67f2-49be-848d-069e7703e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:52.474286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f088353-67f2-49be-848d-069e7703e9f1 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.474568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f088353-67f2-49be-848d-069e7703e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.474837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f088353-67f2-49be-848d-069e7703e9f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.475632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f088353-67f2-49be-848d-069e7703e9f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:52.477056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f088353-67f2-49be-848d-069e7703e9f1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:52.501116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 475/931] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:25:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:52.666085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff6f3c-3140-4d8c-a9cb-8f67fcc156eb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.666604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff6f3c-3140-4d8c-a9cb-8f67fcc156eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.666679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff6f3c-3140-4d8c-a9cb-8f67fcc156eb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.668325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 457/932] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:52.673906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff0f77-7cfe-44e4-80af-9b5733b17c92 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.674193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff0f77-7cfe-44e4-80af-9b5733b17c92 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.674470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff0f77-7cfe-44e4-80af-9b5733b17c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.695855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f0ff0f77-7cfe-44e4-80af-9b5733b17c92 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:52.696983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f0ff0f77-7cfe-44e4-80af-9b5733b17c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:52.743409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:52.774686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 476/933] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:52.799236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff6f3c-3140-4d8c-a9cb-8f67fcc156eb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:52.812208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:52.908989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff6f3c-3140-4d8c-a9cb-8f67fcc156eb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:52.944951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:52.946057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.946537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.947166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.948069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:52.949732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:52.951400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING keystone.server.flask.common [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 22:25:52.970404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.sql.core [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 22:25:52.970404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 22:25:52.970404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [parameters: {'id': '43b29ce4e33e415796598cecb91bf212', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 22:25:52.970404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 43b29ce4e33e415796598cecb91bf212.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 43b29ce4e33e415796598cecb91bf212. Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:25:52.988358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 22:25:52.989219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application yield resource Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise self.value Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application session.commit() Jul 21 22:25:52.990139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.flush() Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application compat.raise_( Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 22:25:52.991052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 22:25:52.991987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:25:52.992910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [parameters: {'id': '43b29ce4e33e415796598cecb91bf212', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:52.994046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:52.994801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 43b29ce4e33e415796598cecb91bf212. Jul 21 22:25:52.995691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:52.997918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 458/934] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jul 21 22:25:52 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:52.999640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d49b-e44d-4bc9-ab81-d9a225e425d7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.999944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d49b-e44d-4bc9-ab81-d9a225e425d7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.000207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d49b-e44d-4bc9-ab81-d9a225e425d7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.002329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 477/935] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:53.003804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.008308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.008591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.008864 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.030706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:53.034353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:53.085309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:53.121783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 478/936] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:53.134515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcb285-d1e0-4853-808b-78bcf32871f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:53.143845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.178343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:53.179185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.179637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.179919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.188597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:53.190956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:53.209592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:53.210499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:53.211433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:53.215073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 459/937] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:53.219664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.259105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a6b2c-a11f-4eba-a72e-315645c606fb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:53.262321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:53.302957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:53.304906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.305371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.306074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.321215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:53.333041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:53.334428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:25:53.335320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:53.339182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 479/938] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:53.342610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.353897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c200-233b-46e3-bb39-0f11bc2a5652 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:53.391384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:53.401355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:53.402114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.402396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.402664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.403443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:53.403744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:53.405296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:53.435681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 460/939] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:53.471308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9913-dad1-45e6-9932-45429cb48d00 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:53.509670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:53.510767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.511295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.511772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.512751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:53.513438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:53.515105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:53.525318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 480/940] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:53.531681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.646457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a0d1c-ef2f-420c-b442-95064dcc0452 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:53.683410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:53.684258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.684544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.684818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.697158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:53.698716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:53.718321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:53.719296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:53.720195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:53.720195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:53.720195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:53.720195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:53.720195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 461/941] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:53.726943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.757296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:53.833394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3902891-84b5-44ed-b15c-3272af20e267 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:53.867671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:53.868346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:53.868628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:53.868904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:53.869634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:53.869940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:53.871357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:53.883932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 481/942] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:53.889905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:53.931922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:53.997866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca3431-5866-422f-8c8f-5892cb103ae4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.036111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.037320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.037828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.038302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.046561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.048280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c793d0f4-001c-4430-bb74-61a3fe19b0a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:54.064097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:54.065073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:54.065996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:54.068676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 462/943] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:25:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:54.075188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.163101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.178238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f3c0-2883-49c7-9856-cb42f41aad35 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.212250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a9f3d-bb60-42a7-b28f-3db28b208e5f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.212558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a9f3d-bb60-42a7-b28f-3db28b208e5f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.212806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a9f3d-bb60-42a7-b28f-3db28b208e5f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.213382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.214124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.214409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.214686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.215456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 463/944] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:54.215611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:54.215883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.217404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.220622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.221088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.221328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.235861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 482/945] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:54.240482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:54.241741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:54.241943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.320660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 464/946] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:54.343258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.352899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f8257-1232-4fce-84ca-4713e42e9c96 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.385902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.393205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.394671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.394671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.394671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.404924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.406793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.409425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:54.427436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:54.428322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:54.429184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:54.429184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:54.429184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:54.429184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:54.431454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 483/947] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:54.437421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.475693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb80fc0-5a75-454b-802f-06796f9f5c0e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.513321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.514151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.514428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.514695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.515387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.516755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:54.531836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:54.532818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:54.533634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:54.538803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 465/948] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:54.540173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.566643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70de5d-6953-45d5-a4cf-1d0a27afd509 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.602472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.603218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.603565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.603908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.604916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:54.605035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.606515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bfc8b-67bb-4365-a3c1-bec14982d7b3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.629749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 484/949] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:54.630898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469d2e3-0874-40d3-8cb5-f1f4a5a1db2e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.631225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469d2e3-0874-40d3-8cb5-f1f4a5a1db2e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.631498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469d2e3-0874-40d3-8cb5-f1f4a5a1db2e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.632877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 485/950] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:25:54.633617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469d2e3-0874-40d3-8cb5-f1f4a5a1db2e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.655321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.665584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d9bc3-d7ad-4bfc-9b51-a14a8a8343ba None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.699557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.700229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.701110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.701566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.702156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.703095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:54.703412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.704910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800841-1349-4160-8c8d-995e430cf9d9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.715136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 466/951] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:54.715136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.715136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.715136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.731182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:54.732458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:54.758013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469d2e3-0874-40d3-8cb5-f1f4a5a1db2e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.795888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.796703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.796973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.797244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.804215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.804982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 467/952] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:54.805904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.813347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:54.820797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:54.821914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:54.822856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 486/953] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:54.827865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.912832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.928894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfd652-40db-41f4-9ec0-b16ce9aa6a59 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.932978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1842d-bc22-4762-8e4a-2c91149268dd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:54.949401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:54.965798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.966533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.966813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.967118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.967864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:54.968133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.969508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.970262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:54.971117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:54.971700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:54.971989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:54.973057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:54.973371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:54.979280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 468/954] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:54.979408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:54.979499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:54.992045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 487/955] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:54.992904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:55.088329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd2adf-7c3b-43cd-b4e2-231103d3dfa1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:55.097696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e20caa-862c-4c42-b919-02681e52b559 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:55.123495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:55.124471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.124754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.125026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.125669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:55.127059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:55.132823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:55.133696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.134173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.134620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.135588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:55.137178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:55.138834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:55.140052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:55.140936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 469/956] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:55.141903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:55.162545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:55.166914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 488/957] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:25:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:55.168073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:55.226834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:55.277418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842123-6c12-4ee1-86c3-6d8d238519cf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:55.327019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ee910-ee9c-4735-87fa-8ad7d9a23e9c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:55.327862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:55.328772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.329049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.329318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/fc8fa6b53b194df0831995429213db40/roles/8057b8f8d6da4311980d9d9de337a382` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.333044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=fc8fa6b53b194df0831995429213db40, role_id=8057b8f8d6da4311980d9d9de337a382)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:55.334635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:55.356958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 470/958] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:25:55 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/fc8fa6b53b194df0831995429213db40/roles/8057b8f8d6da4311980d9d9de337a382 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:55.379805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:55.381114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.381114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.381114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.381800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:55.382111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:55.383909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7bdd0-2702-4029-bc07-55395d0b3b42 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:55.389933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 489/959] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:55.395761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:55.477007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:55.512766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4bf4e-3890-4137-80aa-6f2f5c3963ab None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:55.549224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:55.549896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.550174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.550442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.551186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:55.551490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:55.552939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec088-f867-4327-9101-83c7bf7bcb3f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:55.558518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 471/960] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:25:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:55.688571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457ac4-99ee-480e-af46-8cb3297413f3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.689266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457ac4-99ee-480e-af46-8cb3297413f3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.689752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457ac4-99ee-480e-af46-8cb3297413f3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.691819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 490/961] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:55.697944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.698241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.698518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.716565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:55.717834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:55.790569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 472/962] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:55.815698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457ac4-99ee-480e-af46-8cb3297413f3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:55.915246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:55.924992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457ac4-99ee-480e-af46-8cb3297413f3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:55.960557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:55.961244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:55.961524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:55.961880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:55.962648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:55.964130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:55.965474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING keystone.server.flask.common [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 22:25:55.979591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.sql.core [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 22:25:55.979591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 22:25:55.979591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [parameters: {'user_id': '9e5177a5cc284c09b3ecfe8aec10d596', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 22:25:55.979591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 21 22:25:55.987530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:25:55.988430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application yield resource Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise self.value Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application session.commit() Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 22:25:55.989390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.flush() Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application compat.raise_( Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 22:25:55.990377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:25:55.992306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:25:55.994257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e5177a5cc284c09b3ecfe8aec10d596', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:55.996200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 22:25:55.998100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:55.999925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 491/963] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 22:25:55 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:56.000339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:56.062309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:56.105576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777605f-1891-4c0e-819a-06d7f2dbfc71 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:56.144075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:56.144892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:56.145173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:56.145448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:56.152921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:56.154451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-382780f2-d38a-4edc-b80a-530e0be9af92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:56.169667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:56.170641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:56.171656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 473/964] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:25:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:56.177212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:56.280106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514827c-1376-4d08-9a76-6aa2844af7a3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:56.314562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:56.315225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:56.315511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:56.315784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:56.316598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:56.316906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:56.318579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da3f33-a4eb-41c9-8fa2-ada649e89939 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:56.363126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 492/965] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 22:25:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:57.336181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97ea8-014d-4867-be4e-2dc439d4be95 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.336767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97ea8-014d-4867-be4e-2dc439d4be95 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.336767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c97ea8-014d-4867-be4e-2dc439d4be95 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.338236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 474/966] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:57.343987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82b3e-e8a4-4043-9a5e-8778e3b96068 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.344423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82b3e-e8a4-4043-9a5e-8778e3b96068 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.344515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb82b3e-e8a4-4043-9a5e-8778e3b96068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.362147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-afb82b3e-e8a4-4043-9a5e-8778e3b96068 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:57.363717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-afb82b3e-e8a4-4043-9a5e-8778e3b96068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:57.374829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.441247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 493/967] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:57.456616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f09eb2-408b-4d7f-9e30-c33e65d0ee68 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.456984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f09eb2-408b-4d7f-9e30-c33e65d0ee68 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.457333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f09eb2-408b-4d7f-9e30-c33e65d0ee68 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.458971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 475/968] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:57.463547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f09eb2-408b-4d7f-9e30-c33e65d0ee68 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:57.464438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.464913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.465191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.484017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:57.485523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:57.558926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 494/969] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:57.575138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f09eb2-408b-4d7f-9e30-c33e65d0ee68 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:57.581843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:57.602229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.615714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:57.616809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.617092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.617364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.618021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:57.619464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ea4e47e0-d491-4013-ac24-acd6aff9f280 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:57.632070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:57.633216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:57.634060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 476/970] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:25:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:57.635238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3afe0-36ef-42c3-9d6c-6f96b7df8526 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.635238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3afe0-36ef-42c3-9d6c-6f96b7df8526 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.635477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3afe0-36ef-42c3-9d6c-6f96b7df8526 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.636984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 477/971] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:57.639712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3afe0-36ef-42c3-9d6c-6f96b7df8526 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:57.651413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.681391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e68-c69d-4f7d-902c-424163209898 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:57.714834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781ae4-b7ba-451c-a156-1a3a3c24469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:57.715751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781ae4-b7ba-451c-a156-1a3a3c24469b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.716004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781ae4-b7ba-451c-a156-1a3a3c24469b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.716278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781ae4-b7ba-451c-a156-1a3a3c24469b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.727191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781ae4-b7ba-451c-a156-1a3a3c24469b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-cd781ae4-b7ba-451c-a156-1a3a3c24469b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:25:57.735586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:57.736529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:57.737352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 495/972] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 22:25:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:57.738051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.738253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.738495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.746489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3afe0-36ef-42c3-9d6c-6f96b7df8526 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:57.755314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:57.756515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:57.780566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:57.781232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.781514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.781789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.782499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:57.782814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:57.784234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:57.789648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 478/973] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:57.790531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:57.825024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 496/974] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:25:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:25:57.831909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:57.849439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.891621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.895241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25dd5-f268-45c7-8007-c2b39bdf98f5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:57.929151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:57.929821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.930097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.930368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.931140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:57.931278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc943669-bf60-4664-93bd-6fa416485787 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:57.931452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:57.932823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:57.940907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 479/975] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:25:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:57.941688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:57.969592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:57.970278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:57.970563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:57.970838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:57.971568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:57.971897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:57.973255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:57.978261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 497/976] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:25:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:57.979064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.037962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3d8eb-cfd1-450d-a1de-3ee76fab1a41 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.051668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:58.072732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.073405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.073686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.073985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.074698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.076176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.077499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecb5e4-9105-4bb7-bc5d-302405fb0505 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.089726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 480/977] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:25:57 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:58.090710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.104661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:58.124364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.125181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.125472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.125730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.138110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.139661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:58.159584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:58.160608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:58.161499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:58.161499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:58.161499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:58.161499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:58.165836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 498/978] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:58.166746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.216481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e9da3-27d1-4f1a-b6a5-f9b2ee0f7233 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.255739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.256412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.256690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.256958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.257768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] RBAC: Adding query filter params (interface=admin, service_id=42b0402724d146d58cb1edff501c5891, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:58.258081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.260312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.267819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 481/979] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Jul 21 22:25:58 2022] GET /identity/v3/endpoints?service_id=42b0402724d146d58cb1edff501c5891&interface=admin®ion_id=RegionOne => generated 193 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:58.273569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.274663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb608a7b-bfa1-423a-a889-ba43607a1acd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.310779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.311490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.311771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.312044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.312768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:58.313074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.314451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.315530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:58.327518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 499/980] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:58.332955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.365921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:58.386048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ca53-a1bb-4537-8638-8c21fff534f0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.422857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.423478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.423760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.424033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.424711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.426092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.443025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 482/981] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:25:58 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:25:58.447882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55193abd-ebed-46d6-92ef-4a4cb272b406 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.485465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.486321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.486600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.486868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.495817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.497437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:25:58.514089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:58.515442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:25:58.516386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 500/982] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:25:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:25:58.521481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.631280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908fc9-a901-4e22-8575-1eb2cd78d7c6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.632957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:58.667922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.668682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.668898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.669166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.669997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:58.670303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.671760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:58.694138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 483/983] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 22:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:25:58.696045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:58.795507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:58.804393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734864-d82e-4fdd-a1ab-adce7cc924e1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:58.847655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:58.848307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:58.848584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:58.848855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:58.935818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:58.937262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:59.030581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:59.039020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 501/984] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:25:58 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:25:59.044698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:59.145090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd129a-cf29-4acb-b084-cfa71502f1c1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:59.186491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:59.187614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:59.187897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:59.188166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:59.199480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:59.200943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:25:59.219416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:59.220559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:59.221620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:25:59.221620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:25:59.221620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:25:59.221620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:59.221620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 484/985] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:59.227432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:59.328672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b01619-e51d-4942-8942-fbd7ced3edfe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:59.361297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:59.361957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:59.362232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:59.362500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:59.363242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:59.363545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:59.364906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:59.388632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 502/986] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:59.389665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:59.405726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:59.499329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3b44-1b39-4235-b4c3-c79ae562ac31 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:59.536139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:59.536958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:59.537239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:59.537513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:59.545397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:59.546890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:25:59.562163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:25:59.563142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:25:59.564018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 485/987] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:25:59.570888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:59.630738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:59.677050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b2493-6610-4a3a-9bfd-1c04bb648371 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:59.710017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:59.710675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:59.710949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:59.711247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:59.712029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:59.712333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:59.713765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce6ca2-5103-426a-b90f-2fb38ca84abd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:59.725924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 503/988] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:59.731911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:59.802587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:59.833705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7e17-f051-40e3-a8f9-687099ff7a29 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:59.867050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:59.867723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:59.867998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:59.868266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:59.869084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] RBAC: Adding query filter params (role.id=8057b8f8d6da4311980d9d9de337a382, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=fc8fa6b53b194df0831995429213db40) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:59.869394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:59.870817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4c695-2500-4b0e-aedb-57fd000643af None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:59.877030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 486/989] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:25:59 2022] GET /identity/v3/role_assignments?user.id=fc8fa6b53b194df0831995429213db40&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=8057b8f8d6da4311980d9d9de337a382 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:00.145347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fcbe8-c0cd-49b1-8c73-7ed0c1bb4f7c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.145596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fcbe8-c0cd-49b1-8c73-7ed0c1bb4f7c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.145885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fcbe8-c0cd-49b1-8c73-7ed0c1bb4f7c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.147474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 504/990] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:00.152849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.153115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.153420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.170876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:00.172102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:00.241528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 487/991] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:00.264153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fcbe8-c0cd-49b1-8c73-7ed0c1bb4f7c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.379412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fcbe8-c0cd-49b1-8c73-7ed0c1bb4f7c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:00.395233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:00.417092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:00.417872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.418155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.418485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.419163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:00.420530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-270a72dc-b248-4fc0-b648-a83cc41462aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:00.432499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:00.433498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:00.439660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 505/992] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:00.441944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.469511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872be44-22b3-440a-8765-f67576f4e823 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.469818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872be44-22b3-440a-8765-f67576f4e823 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.470020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872be44-22b3-440a-8765-f67576f4e823 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.471607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 506/993] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:26:00.476216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.476504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.476856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.496967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:00.498180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:00.512721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:00.564385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a86c6-fae5-402d-9175-026b11794998 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:00.581937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 507/994] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:26:00.599604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:00.600554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.600976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.601389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.602243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:00.602688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:00.604253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:00.605122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.609769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 488/995] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:00.615347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.708149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe251f-5a12-4ec3-915e-e0972dc9cad6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:00.717371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:00.724800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15563a-0e70-44e3-890b-011697e537f2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:00.744536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:00.745530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.745952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.746231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.746956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:00.748374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:00.754751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:00.760747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:00.761722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:26:00.762580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:00.763351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:00.763437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 508/996] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:00.763506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.763506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.763640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.764331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:00.764643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:00.766010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:00.768732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.775986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 489/997] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:00.776677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.873361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97a758-1576-4cde-8409-fea1370aa38a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:00.886683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d289e16-d986-475f-92c2-2b05314b8932 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:00.910829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:00.911549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.911834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.912115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.912822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:00.913130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:00.914511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:00.920128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 509/998] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:00.925810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.929271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:00.929998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:00.930282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:00.930557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:00.931415 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] RBAC: Adding query filter params (interface=public, service_id=f5b50cece809420eaadb36e1e38eb91f, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:00.931725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:00.933093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:00.939045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 490/999] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/endpoints?service_id=f5b50cece809420eaadb36e1e38eb91f&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:00.944776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:00.963716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:01.007510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:01.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564dadd-d119-4d42-a34c-ee7ba060e088 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:01.053844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01fe5b-d371-42cf-9351-c836b3e553e7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:01.071388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:01.072077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:01.072360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:01.072647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:01.073363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:01.073665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:01.075139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:01.080330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 510/1000] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:01.086041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:01.094734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9380-44ad-4ec6-8849-66e5724f57ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:01.095684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9380-44ad-4ec6-8849-66e5724f57ef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:01.095965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9380-44ad-4ec6-8849-66e5724f57ef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:01.096237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9380-44ad-4ec6-8849-66e5724f57ef None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:01.096924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9380-44ad-4ec6-8849-66e5724f57ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:01.098298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9380-44ad-4ec6-8849-66e5724f57ef None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:01.104989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 491/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:26:00 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:26:01.205867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:01.210210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0bb1-d55d-4443-b836-687c85c17069 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:01.259340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d01b6-3d50-44fa-ba0c-b8439a1f7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:01.259915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d01b6-3d50-44fa-ba0c-b8439a1f7609 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:01.260201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d01b6-3d50-44fa-ba0c-b8439a1f7609 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:01.260477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d01b6-3d50-44fa-ba0c-b8439a1f7609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:01.261220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d01b6-3d50-44fa-ba0c-b8439a1f7609 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:01.262680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d01b6-3d50-44fa-ba0c-b8439a1f7609 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:01.281670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 511/1002] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:26:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:01.927320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe11b-6abc-4acb-9bcd-9e1479c610d0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:01.927869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe11b-6abc-4acb-9bcd-9e1479c610d0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:01.927869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe11b-6abc-4acb-9bcd-9e1479c610d0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:01.929446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 492/1003] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:01.934694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:01.935203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:01.935277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:01.952508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:01.953701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:02.026711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 512/1004] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:02.048849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe11b-6abc-4acb-9bcd-9e1479c610d0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:02.155692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe11b-6abc-4acb-9bcd-9e1479c610d0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:02.178023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:02.191023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:02.191691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:02.191966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:02.192233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] PATH_INFO: `/v3/services/image` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:02.192878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:02.194249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:02.206141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:02.207137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:02.207991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 493/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jul 21 22:26:02 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:02.213441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:02.301242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:02.317739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c6adf-3885-4d96-9540-98b9b6235a07 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:02.351519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:02.352239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:02.352543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:02.352788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:02.353488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] RBAC: Adding query filter params (name=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:02.353791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:02.355217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df15b9-69a7-40a7-9831-a21e58be8e54 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:02.360197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 513/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:02.365677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:02.482047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e9c-4d2c-4c92-a178-4c4ca963dd53 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:02.516830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:02.517499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:02.517768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:02.518037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:02.518790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:02.519140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:02.520505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb80aea-9b85-47ed-b5e5-5558e325fd31 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:02.525225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 494/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:03.142513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba189-1e8f-427c-946e-08a1bd2c7c39 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.143123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba189-1e8f-427c-946e-08a1bd2c7c39 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.143123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ba189-1e8f-427c-946e-08a1bd2c7c39 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.144625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 514/1008] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:03.149732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e269e-44fb-4a83-88c9-24791bd27df5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.150155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e269e-44fb-4a83-88c9-24791bd27df5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.150231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e269e-44fb-4a83-88c9-24791bd27df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.167646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2a2e269e-44fb-4a83-88c9-24791bd27df5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:03.168867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2a2e269e-44fb-4a83-88c9-24791bd27df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:03.218434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:03.241081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 495/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:03.263955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba189-1e8f-427c-946e-08a1bd2c7c39 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:03.326599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7841-bebc-4db2-83c9-314471ad4535 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.326923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7841-bebc-4db2-83c9-314471ad4535 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.327191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7841-bebc-4db2-83c9-314471ad4535 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.328588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 496/1010] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:26:03.333539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.333810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.334084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.350482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:03.351712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:03.370328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ba189-1e8f-427c-946e-08a1bd2c7c39 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:03.406619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:03.407378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.407659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.407934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.408585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:03.409960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:03.422047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:03.423082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:03.424106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 515/1011] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:26:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:03.429051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:03.431057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 497/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:26:03.451691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:03.454003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:03.540650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35166d03-3b5a-4975-935e-d6f7d61846f0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:03.555799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1bffa-73e4-4698-aab2-cc8edd66bef5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:03.566767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:03.578371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:03.579112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.579462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.579739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.580447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:03.580934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:03.582157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:03.587522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 516/1013] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:26:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:03.593654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:03.597074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:03.597894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.598177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.598449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.600594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:03.601884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:03.603841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 498/1014] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:03.609760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:03.681382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:03.704024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fbfc3-463e-4a0e-8f45-3fc334519572 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:03.716400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529ff68-1857-4933-8ccd-3d335220b939 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:03.737952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:03.739022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.739322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.739597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.740314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:03.740621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:03.742005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:03.749892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 517/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 22:26:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:03.752512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:03.758078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588b582-bdd2-4d7c-84b6-c5c0a178f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:03.758752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b582-bdd2-4d7c-84b6-c5c0a178f8f0 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.759054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b582-bdd2-4d7c-84b6-c5c0a178f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.759328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588b582-bdd2-4d7c-84b6-c5c0a178f8f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.760037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588b582-bdd2-4d7c-84b6-c5c0a178f8f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:03.761484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588b582-bdd2-4d7c-84b6-c5c0a178f8f0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:03.799210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 499/1016] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:26:03 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:26:03.859482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6add3fd-e32e-417f-a242-c87810add408 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:03.902946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2a84-e5f1-4969-bb8e-63838bb41af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:03.903957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2a84-e5f1-4969-bb8e-63838bb41af0 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:03.904833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2a84-e5f1-4969-bb8e-63838bb41af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:03.905263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2a84-e5f1-4969-bb8e-63838bb41af0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:03.906249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a2a84-e5f1-4969-bb8e-63838bb41af0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:03.913859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a2a84-e5f1-4969-bb8e-63838bb41af0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:03.936126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:03.947926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 518/1017] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:26:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:26:04.554443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fefdd2-6483-4f34-a817-70438d8e2e81 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:04.555007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fefdd2-6483-4f34-a817-70438d8e2e81 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:04.555007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fefdd2-6483-4f34-a817-70438d8e2e81 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:04.556609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 500/1018] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:04.561881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a85c-ae31-4353-9dbb-70b3131b2b17 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:04.562326 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a85c-ae31-4353-9dbb-70b3131b2b17 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:04.562403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a85c-ae31-4353-9dbb-70b3131b2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:04.580083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cd87a85c-ae31-4353-9dbb-70b3131b2b17 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:04.581276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cd87a85c-ae31-4353-9dbb-70b3131b2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:04.657616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 519/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:04 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:04.680070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fefdd2-6483-4f34-a817-70438d8e2e81 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:04.712092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:04.790503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fefdd2-6483-4f34-a817-70438d8e2e81 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:04.826225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03d59-3fad-4016-960a-d42cf667126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:04.826898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03d59-3fad-4016-960a-d42cf667126f None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:04.827205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03d59-3fad-4016-960a-d42cf667126f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:04.827478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03d59-3fad-4016-960a-d42cf667126f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:04.828221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f03d59-3fad-4016-960a-d42cf667126f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:04.829593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f03d59-3fad-4016-960a-d42cf667126f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:04.851019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 501/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:26:04 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:05.869031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19872bc-e9b3-4bec-92be-64ffc2633ad6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:05.869580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19872bc-e9b3-4bec-92be-64ffc2633ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:05.869580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19872bc-e9b3-4bec-92be-64ffc2633ad6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:05.871218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 520/1021] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:05.876466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d3dff-007d-43ae-afc5-c5afad715beb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:05.876910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d3dff-007d-43ae-afc5-c5afad715beb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:05.877054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d3dff-007d-43ae-afc5-c5afad715beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:05.895235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-297d3dff-007d-43ae-afc5-c5afad715beb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:05.896420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-297d3dff-007d-43ae-afc5-c5afad715beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:05.975037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 502/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:05.998939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19872bc-e9b3-4bec-92be-64ffc2633ad6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.042660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39a16-7a20-469d-84af-98cfa57a34db None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.042943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39a16-7a20-469d-84af-98cfa57a34db None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.043252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39a16-7a20-469d-84af-98cfa57a34db None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.044775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 503/1023] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:26:06.049472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.049760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.050070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.067350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:06.068531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:06.079954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:06.112201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19872bc-e9b3-4bec-92be-64ffc2633ad6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.137794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:06.145444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 504/1024] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:26:06.151297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:06.152375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.152795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.153298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.154971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:06.156574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:06.158345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 521/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:06.164163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.169370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.267103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15754a6a-16a1-44cf-ad7f-e1b465229c94 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.276426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a159472-7633-43d2-9fc9-e4085000330c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.303443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:06.304269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.305209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.305582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.306314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:06.308067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:06.312311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:06.313136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.313414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.313687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.325038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:06.334075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:06.335041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:06.336017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 522/1026] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 22:26:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:06.347242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 505/1027] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:26:06 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:06.347452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.406762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:06.460533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfdaeb-1c84-40d2-a1f5-15cbbe2c4bd3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.497945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:06.498619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.498920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.499219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.499992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:06.500294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:06.501684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:06.510349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 523/1028] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:26:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:06.516273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.520042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:06.627162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473845af-be14-4abd-af2a-2ae365839e56 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.662214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:06.662947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.663259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.663533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.674909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:06.676398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:06.694044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:06.695106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:06.696000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:06.696000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:06.696000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:06.696000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:06.696000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 506/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:06.702568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.804530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf27fb-ebc0-47a8-a5f3-151d7bf36754 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.818454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:06.839935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:06.840597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.840885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.841159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.841882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:06.842190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:06.843596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb387a7c-a4a0-410f-a8d3-9ee3e19879b2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:06.855956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 524/1030] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:06.861570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:06.880489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326405-ea54-4db0-b365-53a8e9bcd060 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.881019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326405-ea54-4db0-b365-53a8e9bcd060 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.881019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34326405-ea54-4db0-b365-53a8e9bcd060 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.882569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 525/1031] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:06.887639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:06.887929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:06.888205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:06.906693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:06.907922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:06.926356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:06.974001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073aa9d-b577-4280-be47-b7ae577b3b6c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:06.981858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 526/1032] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:07.004506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.009073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.009876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.010126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.010386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.018798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.020286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:26:07.035598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:07.036565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:07.037839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 507/1033] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:26:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:07.042666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.110194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e5a54-f33c-43a7-8851-9c7b3519c5a0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.112732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.147074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.148133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.148587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.149055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] PATH_INFO: `/v3/services/image` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.149859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.150081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4cbf7-e9fc-4a34-bf6d-f988a7a301ae None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.151605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:07.163955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:07.164952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:07.165785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 527/1034] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:07.167867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.171526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.190873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.191515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.191796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.192068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.192910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:07.193224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.194679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.212032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 508/1035] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:07.217743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.280490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515c2d8-5c34-4f1e-a975-d64900508a81 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.313424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac748c0-4324-4aef-b435-db32658166bf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.317638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.318549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.319057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.319555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.320584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] RBAC: Adding query filter params (name=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:07.320959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.322454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.327852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 528/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:07.333658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.347270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.348194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.348479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.348740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.366295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.395038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.422898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.424378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.447345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830bf1-91f5-47b9-ad98-d8949509efda None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.483079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.483769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.484042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.484315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.485029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] RBAC: Adding query filter params (type=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:07.485345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.486712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.491681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 529/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:07.497641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.536851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 509/1038] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:07.542635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.598784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.606600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888430-62db-4a31-9d57-fc0a5186c3de None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.615070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.643169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.643835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.644118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.644388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.645181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] RBAC: Adding query filter params (interface=public, service_id=67f6d2d6242e4916a4de00979efa3173, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:07.645495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.646882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.652068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 530/1039] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/endpoints?service_id=67f6d2d6242e4916a4de00979efa3173&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:07.657108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccecdd-cd29-42cd-b531-8c0c7b2166a6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.658142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.689265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.690063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.690344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.690618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.701349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.702748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:07.720711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:07.721738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:07.722788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:07.722788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:07.722788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:07.722788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:07.726725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 510/1040] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:07.727655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.767432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf264-d64f-4088-b279-9756738d2f1d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.806743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.807449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.807740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.808017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.808712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.810098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.817306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 531/1041] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:26:07.830200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5162-fe43-4b08-bb6c-ac5b4a5e9742 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:07.857382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:07.871243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:07.871945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:07.872225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:07.872496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:07.873239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:07.873548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:07.875022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:07.889228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 511/1042] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:07.894979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:07.925067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:08.010281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade446e5-87d8-4fe0-9eff-f0eebc69cdcf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:08.045205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:08.046014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.046288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.046560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.053512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:08.054968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:26:08.069304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:08.070285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:08.071394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 532/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:08.076455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:08.180421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd536124-1c1d-43f8-9ddd-c418f925f183 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:08.214242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:08.214901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.215203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.215474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.216248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:08.216610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:08.218067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15941228-5943-4316-99eb-e5d9a573ef3d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:08.229834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 512/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:08.235794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:08.327413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:08.345059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cdd21-e469-4e29-a6a9-5333ceae9815 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:08.387309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:08.387973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.388247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.388519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.389351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] RBAC: Adding query filter params (role.id=8057b8f8d6da4311980d9d9de337a382, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d1ef9948ee7a4b2b86b823b7e97a7d77) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:08.389656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:08.391100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d3044-bd59-4bfc-9f36-0db1401630ae None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:08.396853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 533/1045] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:08 2022] GET /identity/v3/role_assignments?user.id=d1ef9948ee7a4b2b86b823b7e97a7d77&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=8057b8f8d6da4311980d9d9de337a382 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:08.479502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821041-dc53-4410-8336-27e3e37fc752 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.479859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821041-dc53-4410-8336-27e3e37fc752 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.480058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60821041-dc53-4410-8336-27e3e37fc752 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.481497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 513/1046] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:08.487579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.487863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.488145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.506546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:08.507851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:08.585088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 534/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:08.608104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821041-dc53-4410-8336-27e3e37fc752 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:08.659723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:08.718916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60821041-dc53-4410-8336-27e3e37fc752 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:08.753006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:08.753812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.754095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.754365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.764782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:08.772448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:08.773350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:08.774194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 514/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:08.781417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:08.864044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:08.890300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb39806-2f80-462b-b28f-48cee3d0e35b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:08.925008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:08.925649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:08.925949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:08.926220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:08.926970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:08.927304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:08.928684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:08.937592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 535/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:08.943594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:09.045716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149378f-234f-4ddc-bea6-c2a4526a5508 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:09.048109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:09.080853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:09.081741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:09.082019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:09.082285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] PATH_INFO: `/v3/users/d626f3f65f4e406e877460d3b33b81e7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:09.095900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] RBAC: Authorizing `identity:get_user(user_id=d626f3f65f4e406e877460d3b33b81e7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:09.097357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:09.099225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 515/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:08 2022] GET /identity/v3/users/d626f3f65f4e406e877460d3b33b81e7 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:09.104983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:09.206783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a2868-5cc8-47c8-924b-3308b0b8acbb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:09.239890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:09.240629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:09.240914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:09.241183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:09.251488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:09.309548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:09.311027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:09.418053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 536/1051] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:09.423862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:09.526873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e950f0-72b0-4ee6-8143-3ce69dc7af8b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:09.562729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3575c8-f061-4246-a7e7-2527dcb31d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:09.563649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3575c8-f061-4246-a7e7-2527dcb31d9c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:09.563914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3575c8-f061-4246-a7e7-2527dcb31d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:09.564188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3575c8-f061-4246-a7e7-2527dcb31d9c None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:09.565382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3575c8-f061-4246-a7e7-2527dcb31d9c None admin] RBAC: Authorizing `identity:get_project(project_id=defb8ffe99674924b083b0602c234a10)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:09.566829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3575c8-f061-4246-a7e7-2527dcb31d9c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:09.568769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 516/1052] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:09 2022] GET /identity/v3/projects/defb8ffe99674924b083b0602c234a10 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:09.575008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:09.617301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:09.677053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45fc06-4627-46f8-bb65-36a54491637e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:09.711158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:09.712006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:09.712425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:09.712834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:09.713855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=defb8ffe99674924b083b0602c234a10, user.id=d626f3f65f4e406e877460d3b33b81e7) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:09.714300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:09.715889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1daf8-6a90-42ae-a8dd-e67e09725991 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:09.721675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 537/1053] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:09 2022] GET /identity/v3/role_assignments?user.id=d626f3f65f4e406e877460d3b33b81e7&scope.project.id=defb8ffe99674924b083b0602c234a10&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:09.865692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088321-c0fa-4944-a58e-6e214d129168 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:09.865909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088321-c0fa-4944-a58e-6e214d129168 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:09.866129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088321-c0fa-4944-a58e-6e214d129168 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:09.867716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 517/1054] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:09.873173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:09.873453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:09.873732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:09.891178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:09.892381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:09.962647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 538/1055] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:09.985733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088321-c0fa-4944-a58e-6e214d129168 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.017531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.092693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088321-c0fa-4944-a58e-6e214d129168 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:10.128050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:10.128803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.129223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.129495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] PATH_INFO: `/v3/services/image` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.130325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:10.131794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:10.144173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:10.145259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:26:10.146084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:10.150378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 518/1056] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jul 21 22:26:09 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:10.151858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.187573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.256696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9a97-a78a-4fc1-a1a0-051435de10d4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:10.292900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:10.293569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.293848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.294120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.294827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] RBAC: Adding query filter params (name=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:10.295173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:10.296550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0530-bfc4-4829-b3e1-86002c49b8fa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:10.301661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 539/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:10.307332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.382350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b24a-9c89-44f6-9fdb-36c5e1cc6160 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.382570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b24a-9c89-44f6-9fdb-36c5e1cc6160 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.382839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b24a-9c89-44f6-9fdb-36c5e1cc6160 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.384257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 540/1058] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:10.392064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919bccc-927d-49d8-9380-901aa837657a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.392524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919bccc-927d-49d8-9380-901aa837657a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.392698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919bccc-927d-49d8-9380-901aa837657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.407930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.410025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7919bccc-927d-49d8-9380-901aa837657a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:10.411359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7919bccc-927d-49d8-9380-901aa837657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:10.415553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b3bc8-cc11-48a6-b4b8-a765b797d368 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:10.450684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:10.451385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.451661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.452168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.452628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:10.452936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:10.454302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:10.459539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 519/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:10.465140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.488773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 541/1060] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:10.511235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919bccc-927d-49d8-9380-901aa837657a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.537841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.573208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86174419-23e7-424f-b01f-580baa56b8f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:10.607692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:10.608348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.608626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.609038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.609679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:10.611011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:10.614938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919bccc-927d-49d8-9380-901aa837657a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:10.631010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 520/1061] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:26:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:10.671978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:10.672725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.673012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.673268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.686508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:10.695396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:10.696406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:26:10.697236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:10.698499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 542/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 22:26:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:10.703111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.721910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.817956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44804a2-0038-40ba-a5f0-8b4dcfc333ca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:10.855334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:10.856022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:10.856304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:10.856577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:10.857336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:10.857654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:10.859105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:10.868262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 521/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:26:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:10.874224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:10.960832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.978220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021398-77c7-45d3-9da2-dac67b3f86bb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:11.012332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:11.013146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.013428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.013698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.024758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:11.026253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:11.044104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:11.044995 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:11.045882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:11.045882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:11.045882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:11.045882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:11.047079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 543/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:11.051325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.134310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:11.158853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575f0d-3125-4f2b-9128-34038e1e6f60 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:11.192200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:11.192871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.193149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.193418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.194132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:11.194432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:11.195826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:11.207882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 522/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:11.213821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.319825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648efd2-dca6-448d-95b8-48f20deaa8fd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:11.354770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:11.355609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.355895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.356170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.359124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:11.365506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:11.367085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:26:11.382226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:11.383372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:26:11.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:11.386120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 544/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:11.391772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.495212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce8452-c275-471a-9ce2-9808c8c11fea None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:11.531471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:11.532141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.532410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.532705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.533532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:11.533840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:11.535315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:11.537948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:11.554139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 523/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:11.559831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.667297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d168a16-ec66-499d-8bb1-07926cbfde9f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:11.700815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:11.701620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.701901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.702172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.713028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:11.714521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-98ff1617-3fe3-489c-a72a-104ecca3ef80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:11.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:11.732836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:11.733721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:11.733721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:11.733721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:11.733721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:11.734525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 545/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:11.738839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.744480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5bcec-dbef-4f9d-b70c-ba7d6b0084d8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.744766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5bcec-dbef-4f9d-b70c-ba7d6b0084d8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.745042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5bcec-dbef-4f9d-b70c-ba7d6b0084d8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.746525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 546/1069] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:11.752488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.752775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.753046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.771398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:11.772997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:11.820641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:11.846373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 547/1070] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:11.847493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904a9a-72d8-42c5-a922-9f763f716424 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:11.868620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.885162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:11.885842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:11.886123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:11.886396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:11.887156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:11.887463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:11.888834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:11.905062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 524/1071] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:11.906270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:11.962083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:11.979162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4230b88-6736-4e2a-897f-9b2064a6c33c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.007629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e747765-7a75-40d5-8100-da3c9ad0e87c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.015132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.015955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.016223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.016496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.027680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:12.035904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:12.037666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:12.038895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 548/1072] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:12.043043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.051263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.052074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.052357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.052633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.059950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.061404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:26:12.076152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:12.077035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:26:12.077914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:12.082284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 525/1073] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:12.083162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.084893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:12.149008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e481e9-4387-44b5-9dd1-085fe6172753 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.183071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.183747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.184027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.184303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.185056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:12.185371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.186738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.195449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 549/1074] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:12.201039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73b55d-7212-4c20-8438-bf3fabc783b0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.201532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.217428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:12.240620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.241293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.241572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.241842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.242618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:12.242924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.244395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.256953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 526/1075] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:12.263162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.307504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:12.310439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875473b-1ac7-4664-b1cd-de6a749620d4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.344319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.345235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.345517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.345845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] PATH_INFO: `/v3/users/d626f3f65f4e406e877460d3b33b81e7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.347220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] RBAC: Authorizing `identity:get_user(user_id=d626f3f65f4e406e877460d3b33b81e7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.348732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.350432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 550/1076] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:12 2022] GET /identity/v3/users/d626f3f65f4e406e877460d3b33b81e7 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:12.356453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.389658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0c51-2fc5-4939-a7aa-94336868fd4a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.426907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.428361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.428792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.429222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d1ef9948ee7a4b2b86b823b7e97a7d77/roles/8057b8f8d6da4311980d9d9de337a382` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.432555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=d1ef9948ee7a4b2b86b823b7e97a7d77, role_id=8057b8f8d6da4311980d9d9de337a382)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.435109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.453242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 527/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:26:12 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/d1ef9948ee7a4b2b86b823b7e97a7d77/roles/8057b8f8d6da4311980d9d9de337a382 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:26:12.465643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590019f0-7ee1-4ac9-adf4-b599e6fbec93 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.505010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fee84-e36e-4a5b-b0d2-57a7d5270dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.505907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fee84-e36e-4a5b-b0d2-57a7d5270dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.506189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fee84-e36e-4a5b-b0d2-57a7d5270dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.506460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fee84-e36e-4a5b-b0d2-57a7d5270dc1 None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.507881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fee84-e36e-4a5b-b0d2-57a7d5270dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=defb8ffe99674924b083b0602c234a10)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.509375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fee84-e36e-4a5b-b0d2-57a7d5270dc1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.516700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 551/1078] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:12 2022] GET /identity/v3/projects/defb8ffe99674924b083b0602c234a10 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:12.517666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.558572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:12.635805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa70b1a-bd67-4018-9b11-d6db22b55beb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.671527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827c1b-fd39-4662-803a-5b8e07adae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.672434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827c1b-fd39-4662-803a-5b8e07adae99 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.672712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827c1b-fd39-4662-803a-5b8e07adae99 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.672981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827c1b-fd39-4662-803a-5b8e07adae99 None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10/users/d626f3f65f4e406e877460d3b33b81e7/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.674970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93827c1b-fd39-4662-803a-5b8e07adae99 None admin] RBAC: Authorizing `identity:create_grant(project_id=defb8ffe99674924b083b0602c234a10, user_id=d626f3f65f4e406e877460d3b33b81e7, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:12.676447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93827c1b-fd39-4662-803a-5b8e07adae99 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:12.690827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 528/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:26:12 2022] PUT /identity/v3/projects/defb8ffe99674924b083b0602c234a10/users/d626f3f65f4e406e877460d3b33b81e7/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:26:12.702162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0fc5-31af-4aff-848f-4e37f7e7313e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.702418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0fc5-31af-4aff-848f-4e37f7e7313e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.702709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0fc5-31af-4aff-848f-4e37f7e7313e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.704403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 552/1080] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:12.710400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.710744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.710911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:12.729850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:12.731102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:12.805096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 529/1081] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:12.827308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe0fc5-31af-4aff-848f-4e37f7e7313e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:12.873142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:12.943795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe0fc5-31af-4aff-848f-4e37f7e7313e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:12.979970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:12.981473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:12.981966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:12.982447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:13.051912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:13.053736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:13.087664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:13.155617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 553/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:13.161377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:13.186497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:13.262782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c453-4833-49d8-a613-9dcb85a22360 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:13.296625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:13.297439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:13.297721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:13.297991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:13.308204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:13.309666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-42d74d44-c132-44f6-a1e3-c50ed00752c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:13.327148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:13.328030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:13.328940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:13.328940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:13.328940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:13.328940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:13.328940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 530/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:13.335438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:13.444999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e66bd-d7cb-45bb-9b1d-98f99cbeee0a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:13.478560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:13.479303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:13.479579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:13.479854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:13.480575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:13.480882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:13.482255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31f24-82d3-4c05-bd9e-cfa8a8aec949 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:13.484609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:13.495058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 554/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:14.497314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb7e5-3e8c-47b4-8726-f2a5fe055aab None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.497862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb7e5-3e8c-47b4-8726-f2a5fe055aab None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.497862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efb7e5-3e8c-47b4-8726-f2a5fe055aab None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.499248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 531/1085] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:14.506587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305d35-3bad-45e8-80a5-e47392a6468e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.507125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305d35-3bad-45e8-80a5-e47392a6468e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.507125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305d35-3bad-45e8-80a5-e47392a6468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.524958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e9305d35-3bad-45e8-80a5-e47392a6468e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:14.526166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e9305d35-3bad-45e8-80a5-e47392a6468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:14.595926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 555/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:14.619798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb7e5-3e8c-47b4-8726-f2a5fe055aab None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:14.697211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7708a-3c0c-4bae-86fe-2269de1cbd9c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.697489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7708a-3c0c-4bae-86fe-2269de1cbd9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.697780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7708a-3c0c-4bae-86fe-2269de1cbd9c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.699193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 556/1087] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:14.702174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:14.704422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.704745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.705171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.722242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:14.723456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:14.727226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efb7e5-3e8c-47b4-8726-f2a5fe055aab None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:14.762284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:14.763144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.763421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.763687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.774111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:14.786788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:14.787755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:14.788561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 532/1088] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 22:26:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:14.794096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 557/1089] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:14.794363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:14.822606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:14.879476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:14.899464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877667e-b10f-43e5-89e6-43d644d87b6e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:14.924208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c619bb-7bf4-4251-a2ca-dfc9cd6bf41c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:14.933467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:14.934141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.934414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.934681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.935453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:14.935751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:14.937134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:14.939365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:14.946201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 533/1090] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:26:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:14.951988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:14.960571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:14.961374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:14.961652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:14.961900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:14.972028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:14.979715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:14.980704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:14.981571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 558/1091] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:14.986866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.052217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898255e-6225-4473-9b18-ccd54ab8d3dd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.082373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc764d-bcf4-452d-bdac-aee0fe91efc3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.085607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.086413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.086694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.086968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.098036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.099316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.099553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.116931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.117608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.117891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:15.117994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:15.118973 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:15.120039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:15.120039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:15.120039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:15.120039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:15.120262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.120262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:15.120262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.120448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 534/1092] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:26:15.120845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.125445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.132981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 559/1093] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:15.138874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.187942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.239102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d612-6d23-4722-af4f-f5125ef90fc5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.242626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03286-25bc-4f20-8d06-a846dd484a77 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.272117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.272818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.273101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.273377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.274090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:15.274406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.275859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.276422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.277315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.277939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.278213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] PATH_INFO: `/v3/users/d626f3f65f4e406e877460d3b33b81e7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.279469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] RBAC: Authorizing `identity:get_user(user_id=d626f3f65f4e406e877460d3b33b81e7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.280889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.282546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 560/1094] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/users/d626f3f65f4e406e877460d3b33b81e7 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:15.288186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 535/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:15.288338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.293596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.334585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.391181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3833c-eeef-46c8-979c-39eeb22cdddd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.396767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a2541-55ee-48f7-a37c-0ce89d3e40f4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.407673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.424685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.425340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.425623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.425901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.431694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.432537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.432818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.433089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.440160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.441615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:26:15.460341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:15.461482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:26:15.462650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:15.466379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 536/1096] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:15.467473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.494321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.495736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.541538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.568495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee22c8-6354-4af5-b196-28373266b354 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.602689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.603421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.603709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.603977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.604202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 561/1097] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:15.604808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:15.605117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.606563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.609770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.623818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 537/1098] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:15.629429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.656813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.706692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148d7c-4412-47d5-8272-3402a0fb3d00 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.728992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd295d4-61d6-4923-9e62-d68122f7d348 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.740849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.741856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.742132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.742402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.743660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] RBAC: Authorizing `identity:get_project(project_id=defb8ffe99674924b083b0602c234a10)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.745221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.746850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 562/1099] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/projects/defb8ffe99674924b083b0602c234a10 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:15.752944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:15.764131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.764792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.765072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.765345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.767732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.833047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.834530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.850715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab264e0-187a-46bb-b1db-f2337291fb8a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:15.860574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:15.884842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:15.885527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:15.885801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:15.886074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:15.886906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=defb8ffe99674924b083b0602c234a10, user.id=d626f3f65f4e406e877460d3b33b81e7) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:15.887321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:15.888747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:15.894653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 563/1100] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/role_assignments?user.id=d626f3f65f4e406e877460d3b33b81e7&scope.project.id=defb8ffe99674924b083b0602c234a10&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:15.936843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 538/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:15.943095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:16.032043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:16.056206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae25fd-1b57-4c18-9e15-7091ce8b155d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:16.090928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:16.091784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:16.092064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:16.092342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:16.102655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:16.104211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:16.121858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:16.122749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:16.124209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:26:16.124209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:16.124209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:26:16.124209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:16.124209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 564/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:16.129051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:16.225976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3717-096c-4440-a0eb-ab6d4031f428 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:16.252719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:16.261068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:16.261724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:16.262001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:16.262270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:16.262981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:16.263310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:16.264673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:16.276166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 539/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:16.282329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:16.390164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf37b8-16cc-4bac-b5d4-06fcc1f1d1ee None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:16.419048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:16.425665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:16.426473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:16.426755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:16.427017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:16.434454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:16.435948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:26:16.450385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:16.451409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:16.452369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 565/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:16.457424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:16.578479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177e73-b074-46fa-9a08-c6f75842d949 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:16.612363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:16.613023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:16.613284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:16.613566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:16.614712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:16.615255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:16.617880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3acec-c776-4cda-8549-d4038584db14 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:16.631259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 540/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:16.637507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:16.742691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bec3f-2f8f-4be2-bed3-c046c2e4fe53 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:16.776227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:16.776880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:16.777528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:16.777806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:16.778643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] RBAC: Adding query filter params (role.id=8057b8f8d6da4311980d9d9de337a382, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=d1ef9948ee7a4b2b86b823b7e97a7d77) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:16.778956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:16.780397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544b294-dfb5-4a10-8a2b-df4f6b4b3503 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:16.786413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 566/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:16 2022] GET /identity/v3/role_assignments?user.id=d1ef9948ee7a4b2b86b823b7e97a7d77&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=8057b8f8d6da4311980d9d9de337a382 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:17.928872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f546f-2e24-4e5a-a898-2a74f20239fe None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:17.929435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f546f-2e24-4e5a-a898-2a74f20239fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:17.929435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f546f-2e24-4e5a-a898-2a74f20239fe None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:17.930805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 541/1107] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:26:17.937328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:17.938009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:17.938244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:17.965620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:17.966827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:18.022304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:18.043595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 567/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:18.068269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f546f-2e24-4e5a-a898-2a74f20239fe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:18.123851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:18.177448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f546f-2e24-4e5a-a898-2a74f20239fe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:18.215544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6107-ef8e-4286-8eec-01fa9fca944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:18.216350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6107-ef8e-4286-8eec-01fa9fca944f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:18.216627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6107-ef8e-4286-8eec-01fa9fca944f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:18.216894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6107-ef8e-4286-8eec-01fa9fca944f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:18.218291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6107-ef8e-4286-8eec-01fa9fca944f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:18.219805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6107-ef8e-4286-8eec-01fa9fca944f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:18.221453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 542/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:18.227698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:18.332581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ac58-937e-4b23-aec3-1608b5dbfc14 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:18.370203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3874-fa31-4975-bc78-11ceda2922dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:18.370869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3874-fa31-4975-bc78-11ceda2922dc None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:18.371186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3874-fa31-4975-bc78-11ceda2922dc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:18.371435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3874-fa31-4975-bc78-11ceda2922dc None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:18.372194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3874-fa31-4975-bc78-11ceda2922dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:18.373652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3874-fa31-4975-bc78-11ceda2922dc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:18.403884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 568/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:26:18 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:20.457066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94f9b-8b8e-4af5-b6d0-834734e48f99 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:20.457849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94f9b-8b8e-4af5-b6d0-834734e48f99 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:20.457996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94f9b-8b8e-4af5-b6d0-834734e48f99 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:20.460205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 543/1111] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:20.466705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:20.467448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:20.467561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:20.489186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:20.490384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:20.528000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:20.565387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 569/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:20.589560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe94f9b-8b8e-4af5-b6d0-834734e48f99 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:20.718218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe94f9b-8b8e-4af5-b6d0-834734e48f99 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:20.735493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:20.754497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:20.755386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:20.755662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:20.755928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] PATH_INFO: `/v3/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:20.757392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] RBAC: Authorizing `identity:get_role(role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:20.758781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:20.760245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 544/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:20 2022] GET /identity/v3/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:20.766223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:20.865555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55534f7-47cd-4fb3-9c4a-b3157ebc1b2b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:20.900463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:20.901320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:20.901912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:20.902218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] PATH_INFO: `/v3/users/9286398633864aa6afc250da02afcafb` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:20.915479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] RBAC: Authorizing `identity:get_user(user_id=9286398633864aa6afc250da02afcafb)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:20.916913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:20.918534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 570/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:20 2022] GET /identity/v3/users/9286398633864aa6afc250da02afcafb => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:20.924840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:21.032594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f13b6-c6ef-4f9f-a420-cd39fd856a4a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:21.067342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:21.067971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:21.068253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:21.068521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:21.120020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:21.140068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:21.142468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:21.245156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 545/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:21.254788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:21.290359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:21.364027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310a2b-a1cf-4a83-b310-59962d586c25 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:21.399907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e684e-6526-4066-9e8c-1f6976e11479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:21.400779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e684e-6526-4066-9e8c-1f6976e11479 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:21.401054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e684e-6526-4066-9e8c-1f6976e11479 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:21.401324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e684e-6526-4066-9e8c-1f6976e11479 None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:21.402884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e684e-6526-4066-9e8c-1f6976e11479 None admin] RBAC: Authorizing `identity:get_project(project_id=defb8ffe99674924b083b0602c234a10)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:21.404348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e684e-6526-4066-9e8c-1f6976e11479 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:21.406039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 571/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:21 2022] GET /identity/v3/projects/defb8ffe99674924b083b0602c234a10 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:21.412632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:21.495990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:21.513483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088e95c-6e98-42f6-b090-fb134d3161be None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:21.548946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:21.549528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:21.549805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:21.550077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:21.550911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] RBAC: Adding query filter params (role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=defb8ffe99674924b083b0602c234a10, user.id=9286398633864aa6afc250da02afcafb) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:21.551253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:21.552693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ff636-9b36-46ff-a8a8-cd2841418a28 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:21.558264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 546/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:21 2022] GET /identity/v3/role_assignments?user.id=9286398633864aa6afc250da02afcafb&scope.project.id=defb8ffe99674924b083b0602c234a10&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:23.557138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ddc32-2cfb-4be1-94e9-70583bf94d2d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:23.557660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ddc32-2cfb-4be1-94e9-70583bf94d2d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:23.557660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ddc32-2cfb-4be1-94e9-70583bf94d2d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:23.559133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 572/1118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:23.564839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:23.565340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:23.565340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:23.583322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:23.592889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:23.676598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 547/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:23.698699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ddc32-2cfb-4be1-94e9-70583bf94d2d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:23.793521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:23.800361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ddc32-2cfb-4be1-94e9-70583bf94d2d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:23.832431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:23.833292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:23.833566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:23.833833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] PATH_INFO: `/v3/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:23.835322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] RBAC: Authorizing `identity:get_role(role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:23.836800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:23.838180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 573/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:23 2022] GET /identity/v3/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:23.844337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:23.942956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:23.972063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52933cb1-7723-4598-af40-7b685365fa9a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:24.010080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:24.010953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:24.011263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:24.011533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] PATH_INFO: `/v3/users/9286398633864aa6afc250da02afcafb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:24.012816 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] RBAC: Authorizing `identity:get_user(user_id=9286398633864aa6afc250da02afcafb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:24.014270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:24.015946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 548/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:23 2022] GET /identity/v3/users/9286398633864aa6afc250da02afcafb => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:24.022057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:24.129274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041ac77-89b9-4070-9ea8-e4a08f266134 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:24.170682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a04a73-5198-4707-a12f-ba53c78f48b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:24.172032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04a73-5198-4707-a12f-ba53c78f48b8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:24.172433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04a73-5198-4707-a12f-ba53c78f48b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:24.172837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a04a73-5198-4707-a12f-ba53c78f48b8 None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:24.174760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a04a73-5198-4707-a12f-ba53c78f48b8 None admin] RBAC: Authorizing `identity:get_project(project_id=defb8ffe99674924b083b0602c234a10)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:24.177055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a04a73-5198-4707-a12f-ba53c78f48b8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:24.179750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 574/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:24 2022] GET /identity/v3/projects/defb8ffe99674924b083b0602c234a10 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:24.185950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:24.289417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97907339-6ba4-40d6-b456-d3cced1c23d1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:24.328176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6300940-9fbb-4df4-8146-63b0a4e52c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:24.329053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300940-9fbb-4df4-8146-63b0a4e52c37 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:24.329333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300940-9fbb-4df4-8146-63b0a4e52c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:24.329595 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300940-9fbb-4df4-8146-63b0a4e52c37 None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10/users/9286398633864aa6afc250da02afcafb/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:24.332203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300940-9fbb-4df4-8146-63b0a4e52c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=defb8ffe99674924b083b0602c234a10, user_id=9286398633864aa6afc250da02afcafb, role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:24.333630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300940-9fbb-4df4-8146-63b0a4e52c37 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:24.353557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 549/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:26:24 2022] PUT /identity/v3/projects/defb8ffe99674924b083b0602c234a10/users/9286398633864aa6afc250da02afcafb/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:26:26.350469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2298-55d8-48a0-9a73-4d5c0faf28a6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:26.351517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2298-55d8-48a0-9a73-4d5c0faf28a6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:26.351517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2298-55d8-48a0-9a73-4d5c0faf28a6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:26.353703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 575/1124] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:26.359928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:26.360369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:26.360472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:26.375271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:26.381757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:26.383606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:26.454906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 550/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:26.478705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2298-55d8-48a0-9a73-4d5c0faf28a6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:26.523787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:26.598244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2298-55d8-48a0-9a73-4d5c0faf28a6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:26.641298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:26.642102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:26.642377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:26.642651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] PATH_INFO: `/v3/roles/a4458c2df7a248ddbbd30e60d9fea288` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:26.644284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] RBAC: Authorizing `identity:get_role(role_id=a4458c2df7a248ddbbd30e60d9fea288)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:26.645658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:26.647035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 576/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:26 2022] GET /identity/v3/roles/a4458c2df7a248ddbbd30e60d9fea288 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:26.656607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:26.778742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb4252-c852-4f32-b0e5-8bebe9153dcc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:26.814164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:26.815035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:26.815342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:26.815617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] PATH_INFO: `/v3/users/9286398633864aa6afc250da02afcafb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:26.816878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] RBAC: Authorizing `identity:get_user(user_id=9286398633864aa6afc250da02afcafb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:26.818326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:26.819991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 551/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:26 2022] GET /identity/v3/users/9286398633864aa6afc250da02afcafb => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:26.828619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:26.930637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:26.933700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c7ba0-817c-41af-8771-664b1b2d67c6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:26.971500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:26.972136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:26.972417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:26.972682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:27.039624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:27.041058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:27.145233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:27.149160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 577/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:27.156299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:27.162404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:27.277247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71a555-67fd-4931-9246-3082181ddd2b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:27.314935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b639a-67a6-496c-b2e8-df605c333113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:27.315821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b639a-67a6-496c-b2e8-df605c333113 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:27.316098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b639a-67a6-496c-b2e8-df605c333113 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:27.316359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b639a-67a6-496c-b2e8-df605c333113 None admin] PATH_INFO: `/v3/projects/defb8ffe99674924b083b0602c234a10` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:27.317596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b639a-67a6-496c-b2e8-df605c333113 None admin] RBAC: Authorizing `identity:get_project(project_id=defb8ffe99674924b083b0602c234a10)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:27.319042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b639a-67a6-496c-b2e8-df605c333113 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:27.320822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 552/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:27 2022] GET /identity/v3/projects/defb8ffe99674924b083b0602c234a10 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:27.331043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:27.441130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9741c-0fe8-44cf-8ba9-4334fd333411 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:27.476601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:27.477301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:27.477583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:27.477860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:27.478702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] RBAC: Adding query filter params (role.id=a4458c2df7a248ddbbd30e60d9fea288, scope.project.id=defb8ffe99674924b083b0602c234a10, user.id=9286398633864aa6afc250da02afcafb) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:27.479034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:27.480470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa5cd-6484-48e3-8f36-c341e6a5769a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:27.486288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 578/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:27 2022] GET /identity/v3/role_assignments?user.id=9286398633864aa6afc250da02afcafb&scope.project.id=defb8ffe99674924b083b0602c234a10&role.id=a4458c2df7a248ddbbd30e60d9fea288 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:29.534616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb42e-7c68-4444-89fd-c3a8b472b35d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:29.535437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb42e-7c68-4444-89fd-c3a8b472b35d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:29.535437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb42e-7c68-4444-89fd-c3a8b472b35d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:29.536573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 553/1131] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:29.542216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:29.542670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:29.542765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:29.561040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:29.562208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:29.621949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:29.631273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 579/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:26:29.655765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb42e-7c68-4444-89fd-c3a8b472b35d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:29.733445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:29.764827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb42e-7c68-4444-89fd-c3a8b472b35d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:29.799878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982a890-ad5c-416d-9549-ba8fb5e32729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:29.800657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982a890-ad5c-416d-9549-ba8fb5e32729 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:29.800934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982a890-ad5c-416d-9549-ba8fb5e32729 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:29.801205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982a890-ad5c-416d-9549-ba8fb5e32729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:29.802422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982a890-ad5c-416d-9549-ba8fb5e32729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:29.803901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982a890-ad5c-416d-9549-ba8fb5e32729 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:29.805586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 554/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:29.812320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:29.917733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f168650-45f9-435f-a95e-ca5d2f1d29f4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:29.953165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffdbd4-91aa-40d6-83fd-757099879512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:29.953810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdbd4-91aa-40d6-83fd-757099879512 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:29.954087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdbd4-91aa-40d6-83fd-757099879512 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:29.954360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdbd4-91aa-40d6-83fd-757099879512 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:29.955084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffdbd4-91aa-40d6-83fd-757099879512 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:29.956537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffdbd4-91aa-40d6-83fd-757099879512 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:29.990856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 580/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:26:29 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:32.014721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad7513-9e81-4c12-9876-d8389c3bc99e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:32.015836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad7513-9e81-4c12-9876-d8389c3bc99e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:32.015836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad7513-9e81-4c12-9876-d8389c3bc99e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:32.017866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 555/1135] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:32.024328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:32.024993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:32.025533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:32.047473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:32.048674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:32.092055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:32.117904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 581/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:32.142602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad7513-9e81-4c12-9876-d8389c3bc99e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:32.254216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad7513-9e81-4c12-9876-d8389c3bc99e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:32.293223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e73c6-7185-42d2-97f6-e9d05b4b6f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:32.293944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e73c6-7185-42d2-97f6-e9d05b4b6f9c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:32.294225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e73c6-7185-42d2-97f6-e9d05b4b6f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:32.294499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e73c6-7185-42d2-97f6-e9d05b4b6f9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:32.295759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e73c6-7185-42d2-97f6-e9d05b4b6f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:32.297221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e73c6-7185-42d2-97f6-e9d05b4b6f9c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:32.298826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 556/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:26:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:32.307579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:32.419099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12544c3-b3f4-479f-a644-c2e0a2fc6403 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:32.455173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8a09-e431-4642-87aa-a57f359673c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:32.455842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8a09-e431-4642-87aa-a57f359673c2 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:32.456124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8a09-e431-4642-87aa-a57f359673c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:32.456397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8a09-e431-4642-87aa-a57f359673c2 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:32.457121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac8a09-e431-4642-87aa-a57f359673c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:32.458563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac8a09-e431-4642-87aa-a57f359673c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:32.480409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 582/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:26:32 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:26:34.516571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014207f4-939b-405f-a3a6-c353a768c98b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:34.517143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014207f4-939b-405f-a3a6-c353a768c98b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:34.517143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014207f4-939b-405f-a3a6-c353a768c98b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:34.518456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 557/1139] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:34.524085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:34.524503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:34.524640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:34.542683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:34.543922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:34.570818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:34.613748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 583/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:26:34.651079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014207f4-939b-405f-a3a6-c353a768c98b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:34.663656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:34.761059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014207f4-939b-405f-a3a6-c353a768c98b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:34.795137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:34.795923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:34.796198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:34.796467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:34.806460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:34.814115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:34.815210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:34.816546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 558/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:34.822799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:34.959023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c3d0c-09fe-48e0-b6d7-3bd712e4ae57 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:34.994320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:34.994977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:34.995287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:34.995557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:34.996307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:34.996604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:34.998002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:35.006242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 584/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:35.015646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:35.095148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:35.129181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02f8d-3dc1-4a90-a7e2-ceb73f791f6c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:35.167084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:35.167967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:35.168248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:35.168523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] PATH_INFO: `/v3/users/2aa72d264bd14adda8c49629e281b24e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:35.182008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa72d264bd14adda8c49629e281b24e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:35.183531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:35.185189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 559/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:35 2022] GET /identity/v3/users/2aa72d264bd14adda8c49629e281b24e => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:35.193834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:35.220325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:35.306945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b9f27-5738-4bfd-afc6-94126fe82f77 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:35.342837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:35.343514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:35.343794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:35.344065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:35.413261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:35.414747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:35.438776 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:35.523668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 585/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:35.533496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:35.640868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b0685-dfc1-40e0-b4ec-09989ce704d1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:35.669194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:35.678886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b1e4-60d1-440e-9d49-ccedc48a5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:35.679781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b1e4-60d1-440e-9d49-ccedc48a5f09 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:35.680054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b1e4-60d1-440e-9d49-ccedc48a5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:35.680327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b1e4-60d1-440e-9d49-ccedc48a5f09 None admin] PATH_INFO: `/v3/projects/945ded8694814647976899ac4c5355f9` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:35.681658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b1e4-60d1-440e-9d49-ccedc48a5f09 None admin] RBAC: Authorizing `identity:get_project(project_id=945ded8694814647976899ac4c5355f9)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:35.683116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b1e4-60d1-440e-9d49-ccedc48a5f09 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:35.684803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 560/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:35 2022] GET /identity/v3/projects/945ded8694814647976899ac4c5355f9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:35.694727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:35.801603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72448e41-130f-4622-b34a-310092a28f19 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:35.825753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:35.841787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:35.842465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:35.842740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:35.843029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:35.843864 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=945ded8694814647976899ac4c5355f9, user.id=2aa72d264bd14adda8c49629e281b24e) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:35.844170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:35.845592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2a234-88c6-4326-8194-2c865b0d3e29 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:35.851244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 586/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:35 2022] GET /identity/v3/role_assignments?user.id=2aa72d264bd14adda8c49629e281b24e&scope.project.id=945ded8694814647976899ac4c5355f9&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:37.834204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a83a1a-4769-4b36-a54b-e86adfce64ff None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:37.835136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a83a1a-4769-4b36-a54b-e86adfce64ff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:37.835136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a83a1a-4769-4b36-a54b-e86adfce64ff None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:37.837358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 561/1147] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:37.843652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:37.844368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:37.844537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:37.865308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:37.866497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:37.948358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 587/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:37.981861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a83a1a-4769-4b36-a54b-e86adfce64ff None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:38.090801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a83a1a-4769-4b36-a54b-e86adfce64ff None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:38.134402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:38.135227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:38.135507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:38.135807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:38.146660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:38.154884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:38.155939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:38.157151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 562/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:38.165382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:38.276550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001ece7-9d50-4415-bc60-229aa745108e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:38.303782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:38.324387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:38.325053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:38.325334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:38.325612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:38.326363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:38.326666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:38.328086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:38.336987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 588/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:38.343436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:38.408029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:38.453249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ed4e-92ed-4958-af74-152a7caf77e9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:38.488105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:38.488962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:38.489236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:38.489506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] PATH_INFO: `/v3/users/2aa72d264bd14adda8c49629e281b24e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:38.490790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa72d264bd14adda8c49629e281b24e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:38.492298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:38.493933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 563/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:38 2022] GET /identity/v3/users/2aa72d264bd14adda8c49629e281b24e => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:38.500244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:38.616829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8b87-92a7-4982-9da0-89741193476a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:38.651319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ddba9-88a4-4da7-8d7c-fb632ee3dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:38.652187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ddba9-88a4-4da7-8d7c-fb632ee3dca2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:38.652456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ddba9-88a4-4da7-8d7c-fb632ee3dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:38.652723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ddba9-88a4-4da7-8d7c-fb632ee3dca2 None admin] PATH_INFO: `/v3/projects/945ded8694814647976899ac4c5355f9` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:38.654001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ddba9-88a4-4da7-8d7c-fb632ee3dca2 None admin] RBAC: Authorizing `identity:get_project(project_id=945ded8694814647976899ac4c5355f9)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:38.655512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ddba9-88a4-4da7-8d7c-fb632ee3dca2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:38.657234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 589/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:38 2022] GET /identity/v3/projects/945ded8694814647976899ac4c5355f9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:38.664564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:38.782115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a07d-ad93-4152-9a49-4925d0bf69a8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:38.804718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:38.817682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee4089-7dc5-4270-a3a0-7eb3fa65e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:38.818574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4089-7dc5-4270-a3a0-7eb3fa65e476 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:38.818852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4089-7dc5-4270-a3a0-7eb3fa65e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:38.819156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4089-7dc5-4270-a3a0-7eb3fa65e476 None admin] PATH_INFO: `/v3/projects/945ded8694814647976899ac4c5355f9/users/2aa72d264bd14adda8c49629e281b24e/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:38.821275 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee4089-7dc5-4270-a3a0-7eb3fa65e476 None admin] RBAC: Authorizing `identity:create_grant(project_id=945ded8694814647976899ac4c5355f9, user_id=2aa72d264bd14adda8c49629e281b24e, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:38.822715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee4089-7dc5-4270-a3a0-7eb3fa65e476 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:38.837657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 564/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:26:38 2022] PUT /identity/v3/projects/945ded8694814647976899ac4c5355f9/users/2aa72d264bd14adda8c49629e281b24e/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:26:40.813075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b130-91f9-4240-8d6e-6a7277891f55 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:40.813659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b130-91f9-4240-8d6e-6a7277891f55 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:40.813659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b130-91f9-4240-8d6e-6a7277891f55 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:40.815121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 590/1154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:40.821807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:40.822515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:40.822695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:40.851277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:40.852487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:40.923165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 565/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:40.955686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b130-91f9-4240-8d6e-6a7277891f55 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:41.016350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.070768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b130-91f9-4240-8d6e-6a7277891f55 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:41.105458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:41.106255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:41.106534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:41.106804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:41.118872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:41.126600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:41.127681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:41.128725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 591/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:41.134645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:41.242386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01722e-fb35-4e11-b490-dbe30bfd65c8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:41.258491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.284997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:41.285674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:41.285953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:41.286223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:41.286972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:41.287307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:41.288687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:41.297062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 566/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:41.305624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:41.415549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce79ff-a33e-48d7-ba36-28bfd44e249a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:41.425190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.452350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:41.453232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:41.453508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:41.453781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] PATH_INFO: `/v3/users/2aa72d264bd14adda8c49629e281b24e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:41.455047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa72d264bd14adda8c49629e281b24e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:41.456493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:41.458161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 592/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:41 2022] GET /identity/v3/users/2aa72d264bd14adda8c49629e281b24e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:41.464478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:41.567029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8ffa7-5a1a-4211-b094-3c5b03c757bc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:41.604430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:41.605067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:41.605344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:41.605613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:41.656443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.683703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:41.685183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:41.787120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 567/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:41.796662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:41.905840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f89c-0e50-4155-afef-58062bc36570 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:41.940379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c960dd8-0f93-4779-8066-82ad91495415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:41.941198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960dd8-0f93-4779-8066-82ad91495415 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:41.941473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960dd8-0f93-4779-8066-82ad91495415 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:41.941763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960dd8-0f93-4779-8066-82ad91495415 None admin] PATH_INFO: `/v3/projects/945ded8694814647976899ac4c5355f9` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:41.942950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c960dd8-0f93-4779-8066-82ad91495415 None admin] RBAC: Authorizing `identity:get_project(project_id=945ded8694814647976899ac4c5355f9)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:41.944454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c960dd8-0f93-4779-8066-82ad91495415 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:41.946128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 593/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:41 2022] GET /identity/v3/projects/945ded8694814647976899ac4c5355f9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:41.952315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:42.032834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:42.060235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7703d-5c88-4846-bf42-d5ebd752a59b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:42.096289 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:42.097230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:42.097568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:42.097918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:42.099177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=945ded8694814647976899ac4c5355f9, user.id=2aa72d264bd14adda8c49629e281b24e) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:42.099477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:42.101646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298aaf4d-f0e6-46f7-9c57-e04fedccdc0d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:42.111745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 568/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:41 2022] GET /identity/v3/role_assignments?user.id=2aa72d264bd14adda8c49629e281b24e&scope.project.id=945ded8694814647976899ac4c5355f9&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:44.131884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704fb67-effb-4c0c-aba4-7eca4ec8b78e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:44.132838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704fb67-effb-4c0c-aba4-7eca4ec8b78e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:44.132838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704fb67-effb-4c0c-aba4-7eca4ec8b78e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:44.135110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 594/1162] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:44.144394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:44.144829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:44.144981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:44.164810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:44.165997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:44.235732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 569/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:44.258010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704fb67-effb-4c0c-aba4-7eca4ec8b78e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:44.306638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:44.362235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704fb67-effb-4c0c-aba4-7eca4ec8b78e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:44.400232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:44.400807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:44.401086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:44.401356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:44.474823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:44.476345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:44.520121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:44.578680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 595/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:44.588207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:44.659915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:44.697860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412363-d7c3-4a7e-8edd-ce5e0173e2b7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:44.732987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:44.733784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:44.734061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:44.734306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:44.741365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:44.742814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-36d7d9ee-5cb0-499e-83fe-20bf82db7fd8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:44.757332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:44.758480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:26:44.759615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 570/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:26:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:44.765077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:44.891938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a69c6-3b79-42db-a969-f4b89b3c0cfd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:44.927828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:44.928463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:44.928749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:44.929025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:44.929760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:44.930067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:44.931485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c2c8c-2d45-41cb-86fc-ccf92cdf2f46 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:44.938781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 596/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 22:26:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:46.955723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f9c89-0a38-4ab4-8943-b1253e7462f9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:46.956290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f9c89-0a38-4ab4-8943-b1253e7462f9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:46.956537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f9c89-0a38-4ab4-8943-b1253e7462f9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:46.958669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 571/1167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:46.966506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7e42-103b-4be2-bfa0-e4082ad87422 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:46.966939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7e42-103b-4be2-bfa0-e4082ad87422 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:46.967053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f7e42-103b-4be2-bfa0-e4082ad87422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:46.988690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-166f7e42-103b-4be2-bfa0-e4082ad87422 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:46.989903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-166f7e42-103b-4be2-bfa0-e4082ad87422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:46.992082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:47.075325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 597/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:47.098362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f9c89-0a38-4ab4-8943-b1253e7462f9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:47.224030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f9c89-0a38-4ab4-8943-b1253e7462f9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:47.250174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:47.260006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ab6d6-f6b9-41ee-9c28-e37845625746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:47.260963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ab6d6-f6b9-41ee-9c28-e37845625746 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:47.261369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ab6d6-f6b9-41ee-9c28-e37845625746 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:47.261769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ab6d6-f6b9-41ee-9c28-e37845625746 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:47.262983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ab6d6-f6b9-41ee-9c28-e37845625746 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:47.265121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ab6d6-f6b9-41ee-9c28-e37845625746 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:47.284167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 572/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Jul 21 22:26:47 2022] POST /identity/v3/domains => generated 267 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:49.305548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb628-74ff-4e52-8476-a37590bb6931 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:49.306447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb628-74ff-4e52-8476-a37590bb6931 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:49.306447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb628-74ff-4e52-8476-a37590bb6931 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:49.308780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 598/1170] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:49.315052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:49.315765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:49.316015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:49.334469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:49.335697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:49.406360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 573/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:49.429563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcb628-74ff-4e52-8476-a37590bb6931 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:49.541168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcb628-74ff-4e52-8476-a37590bb6931 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:49.577187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97cb9f-a147-4d51-a06f-ee41d1d2a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:49.577976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cb9f-a147-4d51-a06f-ee41d1d2a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:49.578253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cb9f-a147-4d51-a06f-ee41d1d2a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:49.578518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97cb9f-a147-4d51-a06f-ee41d1d2a7c5 None admin] PATH_INFO: `/v3/domains/7609c3cf2a1748ceb213b563098ead22` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:49.585511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:49.590576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cb9f-a147-4d51-a06f-ee41d1d2a7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7609c3cf2a1748ceb213b563098ead22)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:49.592072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97cb9f-a147-4d51-a06f-ee41d1d2a7c5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:49.593742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 599/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jul 21 22:26:49 2022] GET /identity/v3/domains/7609c3cf2a1748ceb213b563098ead22 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:49.599829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:49.718473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d22cb-e783-45d1-8453-200d2dd826d4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:49.735720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:49.760536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184c9c-2514-4cde-ba2f-c61d25f16b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:49.761234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184c9c-2514-4cde-ba2f-c61d25f16b08 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:49.761516 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184c9c-2514-4cde-ba2f-c61d25f16b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:49.761793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184c9c-2514-4cde-ba2f-c61d25f16b08 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:49.762499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40184c9c-2514-4cde-ba2f-c61d25f16b08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:49.764012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40184c9c-2514-4cde-ba2f-c61d25f16b08 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:49.792293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 574/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:26:49 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:51.838631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c850f-6339-44fe-9488-37b15de59be5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:51.839471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c850f-6339-44fe-9488-37b15de59be5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:51.839827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c850f-6339-44fe-9488-37b15de59be5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:51.842075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 600/1174] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:51.847488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:51.847905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:51.848013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:51.867042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:51.868226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:51.936196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 575/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:51.960891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c850f-6339-44fe-9488-37b15de59be5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:52.075018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c850f-6339-44fe-9488-37b15de59be5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:52.117501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6896-2390-42ad-95df-efb2b98a9070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:52.118302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6896-2390-42ad-95df-efb2b98a9070 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:52.118582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6896-2390-42ad-95df-efb2b98a9070 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:52.118852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6896-2390-42ad-95df-efb2b98a9070 None admin] PATH_INFO: `/v3/domains/7609c3cf2a1748ceb213b563098ead22` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:52.120096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba6896-2390-42ad-95df-efb2b98a9070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7609c3cf2a1748ceb213b563098ead22)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:52.121548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba6896-2390-42ad-95df-efb2b98a9070 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:52.123207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 601/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jul 21 22:26:51 2022] GET /identity/v3/domains/7609c3cf2a1748ceb213b563098ead22 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:52.129639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:52.226920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:52.230142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299f16-c71e-4706-bae0-fa55b40e1244 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:52.272085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ecdac-ce51-4c31-8ee8-c86fa61c1ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:52.272805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ecdac-ce51-4c31-8ee8-c86fa61c1ced None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:52.273439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ecdac-ce51-4c31-8ee8-c86fa61c1ced None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:52.273745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ecdac-ce51-4c31-8ee8-c86fa61c1ced None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:52.274454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ecdac-ce51-4c31-8ee8-c86fa61c1ced None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:52.275964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ecdac-ce51-4c31-8ee8-c86fa61c1ced None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:52.297247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 576/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:26:52 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:26:54.410813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd347-d029-4564-8d52-f1b84ac1069e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:54.411446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd347-d029-4564-8d52-f1b84ac1069e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:54.411446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dd347-d029-4564-8d52-f1b84ac1069e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:54.412878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 602/1178] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:54.419386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:54.420105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:54.420262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:54.446731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:54.447970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:54.518644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 577/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:54.549903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd347-d029-4564-8d52-f1b84ac1069e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:54.618526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:54.653463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dd347-d029-4564-8d52-f1b84ac1069e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:54.686109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:54.686901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:54.687210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:54.687483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:54.698291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:54.705944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:54.707140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:54.708283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 603/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:54.713317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:54.807213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:54.832227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15b415-20c7-4d0f-97b0-17d7bfc39b8e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:54.869028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:54.869698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:54.869976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:54.870245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:54.871025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:54.871322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:54.872686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:54.880585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 578/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:26:54.886646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:54.990479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cccf3-e8eb-4c3d-9b47-32f3fcc837b0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:55.018017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:55.027921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:55.028787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:55.029067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:55.029339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] PATH_INFO: `/v3/users/387140425fea4a1299290af065d2c0fb` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:55.043020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] RBAC: Authorizing `identity:get_user(user_id=387140425fea4a1299290af065d2c0fb)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:55.044487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:55.046144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 604/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:54 2022] GET /identity/v3/users/387140425fea4a1299290af065d2c0fb => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:55.052224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:55.169148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576ed5-106d-40d3-9a61-d0831d351a5c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:55.204748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:55.205398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:55.205678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:55.205944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:55.223887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:55.276933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:55.278332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:55.378915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 579/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:26:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:55.385528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:55.500329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294e847-7dca-43a1-8afe-9e23199ba4fc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:55.536468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5a55-c0fd-4957-9b99-7b43d4c18edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:55.537277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5a55-c0fd-4957-9b99-7b43d4c18edc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:55.537555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5a55-c0fd-4957-9b99-7b43d4c18edc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:55.537831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5a55-c0fd-4957-9b99-7b43d4c18edc None admin] PATH_INFO: `/v3/projects/a05e4191ba7a4792b67e8d006af0c3db` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:55.539202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5a55-c0fd-4957-9b99-7b43d4c18edc None admin] RBAC: Authorizing `identity:get_project(project_id=a05e4191ba7a4792b67e8d006af0c3db)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:55.540663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5a55-c0fd-4957-9b99-7b43d4c18edc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:55.542425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 605/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:55 2022] GET /identity/v3/projects/a05e4191ba7a4792b67e8d006af0c3db => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:55.549660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:55.601002 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:55.653316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470be17-c4f5-4f6f-8a20-925b3cd35c7e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:55.690503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:55.691170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:55.691448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:55.691719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:55.692542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=a05e4191ba7a4792b67e8d006af0c3db, user.id=387140425fea4a1299290af065d2c0fb) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:55.692876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:55.694320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016c03-2179-4b98-b750-7b3dd5cd684c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:55.700396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 580/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:26:55 2022] GET /identity/v3/role_assignments?user.id=387140425fea4a1299290af065d2c0fb&scope.project.id=a05e4191ba7a4792b67e8d006af0c3db&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:57.697904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ac44-5cfd-43e7-b70f-808c32c23525 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:57.698779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ac44-5cfd-43e7-b70f-808c32c23525 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:57.698779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ac44-5cfd-43e7-b70f-808c32c23525 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:57.700928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 606/1186] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:26:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:26:57.707395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:57.708087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:57.708369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:57.726820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:26:57.728037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:26:57.812958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 581/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:26:57.843680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ac44-5cfd-43e7-b70f-808c32c23525 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:57.905450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:57.962873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ac44-5cfd-43e7-b70f-808c32c23525 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:57.997267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:57.998050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:57.998332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:57.998600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:58.009904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:26:58.017609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:26:58.018709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:26:58.024138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 607/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:26:58.027509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:58.075196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:58.137923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c358-aee3-439b-9e02-c37dc522c949 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:58.180643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:58.181578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:58.182001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:58.182410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:58.183600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:26:58.184077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:58.186092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:58.197357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 582/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:58.204514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:58.322712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03ee78-a25e-4c83-9e2e-36d8e8846fb7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:58.335514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:58.357588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:58.358472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:58.358749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:58.359031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] PATH_INFO: `/v3/users/387140425fea4a1299290af065d2c0fb` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:58.360256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=387140425fea4a1299290af065d2c0fb)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:58.361706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:58.363384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 608/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:26:58 2022] GET /identity/v3/users/387140425fea4a1299290af065d2c0fb => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:58.369752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:58.471040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef810-74d2-446a-98e9-add5a8ffab4d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:58.473389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:58.508326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a08cc9-c850-4508-919c-b9c8758d003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:58.509199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a08cc9-c850-4508-919c-b9c8758d003a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:58.509468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a08cc9-c850-4508-919c-b9c8758d003a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:58.509736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a08cc9-c850-4508-919c-b9c8758d003a None admin] PATH_INFO: `/v3/projects/a05e4191ba7a4792b67e8d006af0c3db` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:58.511033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a08cc9-c850-4508-919c-b9c8758d003a None admin] RBAC: Authorizing `identity:get_project(project_id=a05e4191ba7a4792b67e8d006af0c3db)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:58.512489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a08cc9-c850-4508-919c-b9c8758d003a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:58.514220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 583/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:26:58 2022] GET /identity/v3/projects/a05e4191ba7a4792b67e8d006af0c3db => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:26:58.520851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:26:58.636759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689ead0-3d26-4abd-b194-83fdf0c89ff3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:26:58.671829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7447fc-d0d8-41a8-96b0-cd1b4ecd9e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:26:58.672772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7447fc-d0d8-41a8-96b0-cd1b4ecd9e78 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:26:58.673048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7447fc-d0d8-41a8-96b0-cd1b4ecd9e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:26:58.673304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7447fc-d0d8-41a8-96b0-cd1b4ecd9e78 None admin] PATH_INFO: `/v3/projects/a05e4191ba7a4792b67e8d006af0c3db/users/387140425fea4a1299290af065d2c0fb/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:26:58.675332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7447fc-d0d8-41a8-96b0-cd1b4ecd9e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=a05e4191ba7a4792b67e8d006af0c3db, user_id=387140425fea4a1299290af065d2c0fb, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:26:58.676772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7447fc-d0d8-41a8-96b0-cd1b4ecd9e78 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:26:58.691640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 609/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:26:58 2022] PUT /identity/v3/projects/a05e4191ba7a4792b67e8d006af0c3db/users/387140425fea4a1299290af065d2c0fb/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:27:00.695532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c24bc-2207-4db8-ad6b-96a26034e357 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:00.696372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c24bc-2207-4db8-ad6b-96a26034e357 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:00.696372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c24bc-2207-4db8-ad6b-96a26034e357 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:00.698560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 584/1193] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:00.704948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:00.705666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:00.705852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:00.724920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:00.726119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:00.763396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:00.799114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 610/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:27:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:27:00.822554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c24bc-2207-4db8-ad6b-96a26034e357 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:00.941098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c24bc-2207-4db8-ad6b-96a26034e357 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:00.993455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:00.994605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:00.995029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:00.995381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:01.010346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:27:01.018003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:27:01.019130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:27:01.020129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 585/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:27:01.028772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:01.135696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af225297-e3f1-4ab4-b69c-85198503f4c4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:01.171486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:01.172148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:01.172430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:01.172700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:01.173445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:27:01.173754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:01.175192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:01.183282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 611/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:27:01.189967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:01.226357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:01.309505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998c06e-106b-4715-bb48-30ae0d286506 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:01.347006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:01.347888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:01.348166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:01.348451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] PATH_INFO: `/v3/users/387140425fea4a1299290af065d2c0fb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:01.349795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=387140425fea4a1299290af065d2c0fb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:01.351279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:01.352926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 586/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 22:27:01 2022] GET /identity/v3/users/387140425fea4a1299290af065d2c0fb => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:27:01.359950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:01.399474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:01.470365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ede766-7e0b-4c21-abf2-4bcafbe9723a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:01.507030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:01.507701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:01.507975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:01.508252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:01.580701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:01.582082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:01.616815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:01.691733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 612/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:27:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:27:01.698594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:01.802028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:01.805003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d3244-af75-46f0-8900-927c54a8b1c3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:01.840390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84b128-83e6-4ec4-a585-8fa44bae5a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:01.841195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84b128-83e6-4ec4-a585-8fa44bae5a69 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:01.841472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84b128-83e6-4ec4-a585-8fa44bae5a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:01.841746 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84b128-83e6-4ec4-a585-8fa44bae5a69 None admin] PATH_INFO: `/v3/projects/a05e4191ba7a4792b67e8d006af0c3db` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:01.842980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84b128-83e6-4ec4-a585-8fa44bae5a69 None admin] RBAC: Authorizing `identity:get_project(project_id=a05e4191ba7a4792b67e8d006af0c3db)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:01.844458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84b128-83e6-4ec4-a585-8fa44bae5a69 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:01.846160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 587/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 22:27:01 2022] GET /identity/v3/projects/a05e4191ba7a4792b67e8d006af0c3db => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:27:01.852669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:01.957274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a14cc7-0a9c-40ac-90b1-339a4cf747d3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:01.987351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:01.993516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:01.994166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:01.994445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:01.994715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:01.995589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=a05e4191ba7a4792b67e8d006af0c3db, user.id=387140425fea4a1299290af065d2c0fb) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:27:01.995899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:01.997353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a538b0b-46a4-4cb3-9329-f847a0a04a27 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:02.003238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 613/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:27:01 2022] GET /identity/v3/role_assignments?user.id=387140425fea4a1299290af065d2c0fb&scope.project.id=a05e4191ba7a4792b67e8d006af0c3db&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:27:11.835251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=16 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:12.000576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:56.897634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562fe9-f866-4a8b-8b8a-67eda28a3d2f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:56.897634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562fe9-f866-4a8b-8b8a-67eda28a3d2f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:56.897634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562fe9-f866-4a8b-8b8a-67eda28a3d2f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:56.898853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 588/1201] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:56.903172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:56.903691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:56.903787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:56.921312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:56.922545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:57.023779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 614/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:27:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:27:57.050136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562fe9-f866-4a8b-8b8a-67eda28a3d2f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:57.190892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562fe9-f866-4a8b-8b8a-67eda28a3d2f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:57.234158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:57.235238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:57.235522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:57.235880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:57.249485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:57.251376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:27:57.279047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:27:57.280116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:27:57.281240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:27:57.281240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:27:57.281240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:27:57.281240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:27:57.281240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 589/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:27:57.286746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:57.422662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d35367-3dd3-4383-b155-0f7288b7e921 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:57.462607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:57.473035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:57.474044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:57.474476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:57.474753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:57.475721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:27:57.476068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:57.477519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c936f7-a58d-4fca-925f-2db5469d452a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:57.496439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 615/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:27:57.497704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:57.566367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:57.625476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6d8cd-ebfc-400a-8806-64c5880b1cfc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:57.667076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777837f7-7f37-4acf-a1fb-f68f3c2f134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:57.667767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777837f7-7f37-4acf-a1fb-f68f3c2f134d None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:57.668066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777837f7-7f37-4acf-a1fb-f68f3c2f134d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:57.668312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777837f7-7f37-4acf-a1fb-f68f3c2f134d None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:57.669047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777837f7-7f37-4acf-a1fb-f68f3c2f134d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:57.670674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777837f7-7f37-4acf-a1fb-f68f3c2f134d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:57.707479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 590/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 22:27:57 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:28:00.008327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f80b45-7fa7-427a-8805-d077d63f7875 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.008934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f80b45-7fa7-427a-8805-d077d63f7875 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.008934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f80b45-7fa7-427a-8805-d077d63f7875 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.010667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 616/1206] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:00.017656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.018247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.018247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.039096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:00.040473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:00.119353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 591/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:00.147284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f80b45-7fa7-427a-8805-d077d63f7875 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:00.283809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f80b45-7fa7-427a-8805-d077d63f7875 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:00.324958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:00.326115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.326473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.326752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.339838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:28:00.350235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:00.351314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:00.352215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 617/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:00.361270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:00.407734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:00.475570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeba953-7883-4e2f-ab01-97a6f4cac5f1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:00.520363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:00.521101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.521384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.521656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.522406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:00.522727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:00.524149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:00.533049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 592/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:28:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:28:00.539299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:00.604026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:00.663588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889e742-de28-48c0-8fa1-6cd9774ea5d9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:00.708945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:00.709788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.710070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.710342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.721923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:00.723551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:00.742950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:00.744602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:00.745741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:00.745741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:00.745741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:00.745741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:00.749006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 618/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:00.750012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:00.855900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:00.858792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1dec1-a75f-4db1-93e8-22186624e276 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:00.894645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:00.895390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.895681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.895943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.896664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:00.896962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:00.898474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:00.915639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 593/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:00.916945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:01.036135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223c1fc-00d2-4881-bd0c-14fde56eab1d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:01.037865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:01.077467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:01.078551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:01.078951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:01.079263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:01.088157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:01.089790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:28:01.105636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:01.107704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:01.108664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 619/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:01.113153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:01.239575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140f4ea-346e-48a7-ba8f-cd8108363ab8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:01.284806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:01.285801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:01.286175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:01.286783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:01.287942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:01.288494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:01.290624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:01.313975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 594/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 22:28:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:01.320848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:01.434366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e2732-fdf5-49e0-9ae1-aaf317087940 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:01.475463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:01.476396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:01.476720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:01.477003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:01.515225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:01.573127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:01.574601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:01.701659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 620/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:28:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:28:01.703432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:01.723924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:01.814899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1943534-c26e-4058-b900-2094c18c4a2d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:01.850755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:01.851593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:01.851882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:01.852187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:01.863150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:01.864674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:01.884119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:01.885292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:01.886716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:01.886716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:01.886716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:01.886716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:01.886716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 595/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:01.891768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:01.970062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:02.011640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871b57-c0ac-48b9-8571-e41d12805607 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:02.051930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:02.052618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:02.053117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:02.053431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:02.054238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:02.054545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:02.056860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:02.071623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 621/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:02.077778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:02.168583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:02.206118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e0d6-f5f2-4f21-8042-b726a64a8a94 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:02.244288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:02.244288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:02.244288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:02.244288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:02.252128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:02.253750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:28:02.270921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:02.272019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:02.273259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:02.276334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 596/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:02.277696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:02.402578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec871779-5c74-49f2-9680-7317d69067d3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:02.428417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:02.443647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:02.444359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:02.444675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:02.444948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:02.445861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:02.446171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:02.447781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094298e-9f57-46a2-8524-96b093bc4048 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:02.460853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 622/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:02.467075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:02.582558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e4801-53cf-48fa-8b48-2b2975a0d664 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:02.617400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:02.624184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:02.626652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:02.626652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:02.626652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:02.627051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=aac86cfdd00a43678c8506217f83ecdf) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:02.627434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:02.628947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11c2d-ff86-43b9-a7e1-7838a77bd74d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:02.635379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 597/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:28:02 2022] GET /identity/v3/role_assignments?user.id=aac86cfdd00a43678c8506217f83ecdf&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:04.710825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c532-8ffc-4c20-8ebb-8b37c311e4b0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:04.711676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c532-8ffc-4c20-8ebb-8b37c311e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:04.711948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c532-8ffc-4c20-8ebb-8b37c311e4b0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:04.714013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 623/1220] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:04.719466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:04.719961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:04.720183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:04.738153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:04.739583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:04.821132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 598/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:04.844447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c532-8ffc-4c20-8ebb-8b37c311e4b0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:04.964055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c532-8ffc-4c20-8ebb-8b37c311e4b0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:05.007937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:05.008981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:05.009304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:05.009704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:05.023520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:28:05.033633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:05.034746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:05.035794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 624/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:05.041676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:05.156818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a379c-5aa3-46fa-a419-a2c546fa83fe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:05.184883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:05.199119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:05.199883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:05.200231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:05.200995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:05.201749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:05.202072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:05.203565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:05.212379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 599/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:05.218399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:05.267889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:05.333124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744793-67fe-4a54-acd5-63fa3ad449ac None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:05.367329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:05.368191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:05.368427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:05.368720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:05.383922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:05.385834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:05.406099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:05.407402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:05.408561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:05.408561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:05.408561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:05.408561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:05.414705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 625/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:05.414852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:05.522699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604237f5-2be6-40e8-896d-0abcda7fb0fc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:05.558373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:05.559196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:05.559509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:05.559783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:05.560689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:05.561025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:05.562499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:05.575750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 600/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:05.582869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:05.684056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:05.691855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96878d-4e29-4b76-bcf6-0e243c2690a8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:05.725593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:05.726398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:05.726657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:05.726926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:05.734973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:05.736523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:28:05.750878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:05.752148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:05.753514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 626/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:05.759067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:05.809012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:05.862107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288e849-4615-45d8-8e10-2373109ea485 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:05.898162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:05.898835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:05.899137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:05.899414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:05.900251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:05.900560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:05.902000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:05.919935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 601/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 22:28:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:05.925788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:06.026654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b653-b6fa-4ad7-854f-7ba43b387820 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:06.062922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:06.063654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.064092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.064340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.076291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:06.077808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:06.096016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:06.097141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:06.098156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:06.098156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:06.098156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:06.098156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:06.098156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 627/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:06.103507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:06.207635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b957-da62-4519-9e1e-49dce8de5091 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:06.210006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:06.242704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:06.243441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.243724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.243998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.244738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:06.245040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:06.246578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:06.258121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 602/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:06.264143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:06.274563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:06.380003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a51cfb-f633-49dc-b338-89611d5c15eb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:06.416681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:06.417574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.417880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.418192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.425399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:06.426926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:28:06.441276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:06.442461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:06.443648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 628/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:06.448794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:06.561688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0fc1d-cf0f-4019-89f9-d22f0a4895ff None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:06.602338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:06.603256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.603588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.603860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.604682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:06.604992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:06.606556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2057d99-b350-4fa9-9210-185461572ec3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:06.621863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 603/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:06.628808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:06.705881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:06.742888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7dac6-7573-47fd-b425-a232eebc340e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:06.780567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbb05c-b81c-40b9-9be9-6b68df56e6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:06.781476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbb05c-b81c-40b9-9be9-6b68df56e6be None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.781755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbb05c-b81c-40b9-9be9-6b68df56e6be None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.782028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbb05c-b81c-40b9-9be9-6b68df56e6be None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/aac86cfdd00a43678c8506217f83ecdf/roles/9be7b3f2b4cc404b9d0d6351509fe767` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.799937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbb05c-b81c-40b9-9be9-6b68df56e6be None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=aac86cfdd00a43678c8506217f83ecdf, role_id=9be7b3f2b4cc404b9d0d6351509fe767)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:06.801383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbb05c-b81c-40b9-9be9-6b68df56e6be None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:06.817296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 629/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:28:06 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/aac86cfdd00a43678c8506217f83ecdf/roles/9be7b3f2b4cc404b9d0d6351509fe767 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:28:08.866199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f963be3-a453-4348-b7cc-b17eda1c2c89 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:08.866865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f963be3-a453-4348-b7cc-b17eda1c2c89 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:08.866865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f963be3-a453-4348-b7cc-b17eda1c2c89 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:08.868317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 604/1233] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:08.873603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:08.874014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:08.874193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:08.891186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:08.892492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:08.963674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 630/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:08.986066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f963be3-a453-4348-b7cc-b17eda1c2c89 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:09.012259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:09.110571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f963be3-a453-4348-b7cc-b17eda1c2c89 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:09.149139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:09.149834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:09.150112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:09.150382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:09.162354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:28:09.170290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:09.171769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:09.172605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 605/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 22:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:09.179956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:09.236468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:09.295894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dcd3f-dbec-417a-acbe-c53699dd3eb8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:09.329825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:09.330506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:09.330786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:09.331104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:09.331823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:09.332134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:09.333481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:09.342103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 631/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 22:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:09.348126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:09.444795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:09.462194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69fa9d-9981-4782-be4f-aebc551ed61a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:09.498056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:09.498862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:09.499183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:09.499458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:09.511753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:09.513244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:09.531565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:09.532616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:09.533538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:09.533538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:09.533538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:09.533538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:09.533538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 606/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:09.539086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:09.648615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcc9d3-05b7-479c-95e8-902cd3268921 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:09.659088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:09.689014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:09.689709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:09.689990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:09.690263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:09.691010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:09.691320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:09.692820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:09.704656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 632/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:09.710460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:09.820559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aabeb-4a27-4780-80e8-614c683497f7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:09.859924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:09.860831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:09.861254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:09.861558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:09.865201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:09.870901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:09.872822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:28:09.888867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:09.890047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:09.891049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 607/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:09.896907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:10.010443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cbb8b-8f1f-4b62-80fd-1b47b4ed347a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:10.047075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:10.047983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:10.048292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:10.048736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:10.049789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:10.050164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:10.052074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:10.072901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 633/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 22:28:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:10.079290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:10.189260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b385-42c8-4ea0-9ae0-a81fc084023c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:10.224110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:10.224772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:10.225045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:10.225340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:10.294001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:10.301610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:10.303100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:10.419387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 608/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:28:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:28:10.425520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:10.456818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:10.538209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37d311-c4df-4646-a50c-23f141cd71e6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:10.573093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:10.573820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:10.574099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:10.574362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:10.584602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:10.586098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:10.603901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:10.604836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:10.605837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:10.605837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:10.605837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:10.605837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:10.605837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 634/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:10.611172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:10.718227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:10.724891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c3f64-4f42-401f-8b0f-e5ba18e0a68f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:10.761815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:10.762526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:10.762855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:10.763199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:10.763931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:10.764278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:10.765787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:10.779730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 609/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:10.786009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:10.876552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:10.902298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2ff53-c45a-49d7-bbfe-159a78347ce0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:10.940031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:10.940839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:10.941120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:10.941388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:10.947963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:10.949421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:28:10.965103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:10.966180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:10.967205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 635/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:10.973174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:11.081632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22934-78e6-47c2-9bd5-1c1f67f72c96 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:11.118226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:11.118892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:11.119216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:11.119529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:11.120346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:11.120678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:11.122111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6c564-304f-439a-89e6-bc15882c8658 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:11.142038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 610/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:11.143277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:11.261277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2be4-bba8-4237-b2ec-b48ca9884a9a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:11.299808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:11.300616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:11.300935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:11.301218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:11.302292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] RBAC: Adding query filter params (role.id=9be7b3f2b4cc404b9d0d6351509fe767, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=aac86cfdd00a43678c8506217f83ecdf) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:11.302676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:11.304325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524eaf-1814-474a-b197-326058884a2e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:11.311088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 636/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:28:11 2022] GET /identity/v3/role_assignments?user.id=aac86cfdd00a43678c8506217f83ecdf&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=9be7b3f2b4cc404b9d0d6351509fe767 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:13.474336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec501-37c0-4ef5-81af-3425fabb9eb9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:13.474879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec501-37c0-4ef5-81af-3425fabb9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:13.474879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec501-37c0-4ef5-81af-3425fabb9eb9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:13.476276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 611/1247] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:13.482226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:13.482692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:13.482917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:13.488948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:13.503241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:13.504450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:13.577252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 637/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:13.600860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec501-37c0-4ef5-81af-3425fabb9eb9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:13.621434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:13.713806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec501-37c0-4ef5-81af-3425fabb9eb9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:13.749001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:13.749796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:13.750073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:13.750348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:13.760694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:28:13.768493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:13.769859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:13.771211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 612/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:13.776223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:13.885336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac90670-c5cd-4309-9093-77b04c5f644a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:13.917911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:13.923398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:13.924140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:13.924409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:13.924684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:13.925444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:13.925743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:13.927146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:13.935841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 638/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:13.941703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:14.025808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:14.051813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8d260-a736-4c7c-aea8-d6e83eaca188 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:14.090664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:14.091518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:14.091799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:14.092074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:14.104900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:14.106461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:14.127264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:14.128232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:14.129099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:14.129099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:14.129099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:14.129099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:14.129099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 613/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:14.136113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:14.261653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838f77-073c-4aee-85a9-06526177f68a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:14.302913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:14.303533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:14.303817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:14.304085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:14.304844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:14.305148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:14.306592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:14.319603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 639/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:14.325630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:14.437897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60b409-84bb-40e6-a160-4052817f9675 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:14.468134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:14.477573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:14.478453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:14.478676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:14.478941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:14.488195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:14.489660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:28:14.507616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:14.508941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:14.509983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 614/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:14.514977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:14.584944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:14.634725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76711-f840-452b-a6f7-fc613f4e0b08 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:14.674295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:14.674977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:14.675290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:14.675564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:14.676440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:14.676796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:14.678463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:14.699611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 640/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 22:28:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:14.706006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:14.826947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618fb4e-f827-4dce-95f7-a30b64cfd7aa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:14.869055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:14.869055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:14.869055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:14.869055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:14.939281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:14.953602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:14.955224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:15.066348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 615/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:28:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:28:15.072382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:15.188540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3546-9e56-493f-8296-61a008350b64 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:15.205491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:15.229794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:15.230763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:15.231075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:15.231351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:15.242920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:15.244509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:15.263664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:15.264613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:15.265554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:15.265554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:15.265554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:15.265554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:15.265554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 641/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:15.272375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:15.365219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:15.379516 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932b4c-67c6-440a-b766-863565f73133 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:15.417516 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:15.418202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:15.418497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:15.418734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:15.419484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:15.419789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:15.421200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:15.433813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 616/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:15.439717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:15.552921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26fdc-6f7d-4bf5-829a-f1145475bf50 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:15.594532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:15.595373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:15.595749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:15.596167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:15.604335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:15.606208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:28:15.621412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:15.622377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:15.628170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 642/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:28:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:15.628752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:15.741597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82394448-493c-405b-b1ef-85a5faa738e0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:15.777447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:15.778153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:15.778430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:15.778765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:15.779634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:15.779953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:15.781447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f60290-c7dc-404a-a302-ba14eb25f4c5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:15.795332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 617/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:28:15.801959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:15.832242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:15.933426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201791f7-2f89-403b-a14f-5a9673dfe20d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:15.968318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:15.969000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:15.969323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:15.969606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:15.970566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=aac86cfdd00a43678c8506217f83ecdf) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:15.970884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:15.972443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872922-72ff-4cc6-8cee-6893f5d95838 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:15.978627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 643/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:28:15 2022] GET /identity/v3/role_assignments?user.id=aac86cfdd00a43678c8506217f83ecdf&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:18.006830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91abe10-9eb3-4e49-b747-2fd9396a9cec None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:18.007747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91abe10-9eb3-4e49-b747-2fd9396a9cec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:18.007747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91abe10-9eb3-4e49-b747-2fd9396a9cec None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:18.009952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 618/1261] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:18.015436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:18.015874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:18.015964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:18.034559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:18.035783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:18.107351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 644/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:18.130435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91abe10-9eb3-4e49-b747-2fd9396a9cec None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:18.147351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:18.254484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91abe10-9eb3-4e49-b747-2fd9396a9cec None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:18.289436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:18.290160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:18.290432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:18.290711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:18.301027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:28:18.308657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:18.309702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:18.310693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 619/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:18.316839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:18.338777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:18.422132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0c0e-3406-4c20-bec2-5b05e52428d5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:18.457016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:18.457674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:18.457948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:18.458217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:18.458969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:18.459301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:18.460670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:18.468808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 645/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:18.475449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:18.558220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:18.596649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ba3f7-f104-487f-b68b-8448936eafe1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:18.635678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:18.636878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:18.637243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:18.637612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:18.657638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:18.659144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:18.680806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:18.681790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:18.682836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:18.682836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:18.682836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:18.682836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:18.682836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 620/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:18.688751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:18.772129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:18.791593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08ac88-395a-4ab6-b501-d710619ffaa0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:18.826384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:18.827042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:18.827315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:18.827585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:18.828304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:18.828604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:18.830053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:18.842642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 646/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:18.852283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:18.962716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeb16f-f689-47b8-b732-b8407506fe82 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:18.987045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:19.010728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:19.011579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:19.011857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:19.012129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:19.020746 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:19.022208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:28:19.037095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:19.038101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:19.039190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 621/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:19.044745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:19.152860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91142-1e55-488c-b4e2-01f5b98ae36c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:19.192905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:19.193658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:19.194021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:19.194297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:19.195249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:19.195560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:19.197116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:19.207321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:19.217101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 647/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 22:28:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:19.223125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:19.338715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a51a-e4cf-42cf-b17e-f528e5f5f90a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:19.386450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:19.387289 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:19.387564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:19.387831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:19.403468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:19.405606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:19.428374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:19.429363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:19.430555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:19.430555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:19.430555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:19.430555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:19.430555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 622/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:19.437590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:19.538614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dede6-9756-42f9-a84f-0c7ad7bdc0b7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:19.573461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:19.574101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:19.574382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:19.574647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:19.575395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:19.575702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:19.577040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:19.588178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 648/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:19.596724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:19.632259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:19.705518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646afd1-af38-47ed-bff0-84cd5180c8be None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:19.748543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:19.749335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:19.749620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:19.749883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:19.756914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:19.758358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:28:19.773524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:19.774534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:19.775475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 623/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:28:19.783140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:19.845122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:19.886893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f526aa1-620c-4188-bfd9-584a670c2463 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:19.923731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:19.924378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:19.924653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:19.924920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:19.925708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:19.926011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:19.927464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf44b0d-8510-4083-8f87-90863191d526 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:19.940142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 649/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:19.948755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:20.047260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:20.058953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893f0f-b753-4061-afa0-319d12500f5f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:20.094974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf8e3-fa4e-493d-aa8b-6ccc85d1d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:20.095716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf8e3-fa4e-493d-aa8b-6ccc85d1d1cb None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:20.095996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf8e3-fa4e-493d-aa8b-6ccc85d1d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:20.096272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf8e3-fa4e-493d-aa8b-6ccc85d1d1cb None admin] PATH_INFO: `/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/aac86cfdd00a43678c8506217f83ecdf/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:20.098293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf8e3-fa4e-493d-aa8b-6ccc85d1d1cb None admin] RBAC: Authorizing `identity:create_grant(project_id=80ff00ec694948f38903c2fa3edca2af, user_id=aac86cfdd00a43678c8506217f83ecdf, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:20.099768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf8e3-fa4e-493d-aa8b-6ccc85d1d1cb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:20.113874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 624/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 22:28:19 2022] PUT /identity/v3/projects/80ff00ec694948f38903c2fa3edca2af/users/aac86cfdd00a43678c8506217f83ecdf/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:28:22.130125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc4d7-28b0-4df8-8136-d5840917f5d5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:22.131037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc4d7-28b0-4df8-8136-d5840917f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:22.131037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cc4d7-28b0-4df8-8136-d5840917f5d5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:22.133264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 650/1274] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:22.141975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:22.142484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:22.142572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:22.165561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:22.166961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:22.244928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 625/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:22.268342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cc4d7-28b0-4df8-8136-d5840917f5d5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:22.377242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cc4d7-28b0-4df8-8136-d5840917f5d5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:22.395756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:22.415233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:22.416036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:22.416312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:22.416581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:22.427132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:28:22.434807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:22.435957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:22.436842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 651/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 22:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:22.442161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:22.528184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:22.549072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3809-7c5c-44ad-a55e-4674a6fd2012 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:22.586392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:22.587395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:22.587775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:22.588152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:22.589295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:22.589725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:22.591926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:22.605192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 626/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 22:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:28:22.613590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:22.747269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d692ffe-8815-4620-881a-58945104b539 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:22.784080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:22.784853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:22.785132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:22.785398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:22.796263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:22.797740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:22.814954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:22.815948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:22.816852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:22.816852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:22.816852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:22.816852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:22.816852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 652/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:22.825047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:22.933892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6f98-64b4-42dc-8235-71909e2fd2ff None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:22.967970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:22.968626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:22.968903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:22.969169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:22.969962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:22.970270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:22.971655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:22.983267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 627/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:22.992258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:23.028064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:23.118503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200466-39b9-45e8-8714-8b97174d6bbf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:23.155606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:23.156434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:23.156717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:23.157115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:23.169788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:23.172378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:28:23.188516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:23.189645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:23.190857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 653/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:23.195680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:23.200080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:23.300637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98144-0128-4fc4-9e41-e3e89d96d99b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:23.339722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:23.340389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:23.340733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:23.340937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:23.341759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:23.342064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:23.343627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:23.360723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 628/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 22:28:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:23.369713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:23.482043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:23.497971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eeae3-08f1-42cc-b512-c401f894f47f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:23.535345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:23.535992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:23.536278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:23.536556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:23.606408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:23.607827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:23.708232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:23.719734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 654/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 22:28:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:28:23.725848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:23.789806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:23.837850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3ae67-d982-4ddd-a266-ef05ccda5e06 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:23.872594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:23.873321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:23.873601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:23.873867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:23.884335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:23.885808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:28:23.903953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:23.904939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:23.907223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:28:23.907223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:28:23.907223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:28:23.907223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:23.907223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 629/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:23.911477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:24.020104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d42144-5f6e-4c58-a19a-dd077b7c2413 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:24.056110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:24.056793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:24.057073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:24.057347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:24.058081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:24.058388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:24.059797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:24.072132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 655/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 22:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:24.077949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:24.189582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ca448-9f5a-43b0-8810-635ce52dbcf6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:24.206024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:24.227582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:24.228392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:24.228673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:24.228946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:24.235693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:24.237144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:28:24.250742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:24.251806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 21 22:28:24.252674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 630/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 22:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:24.258199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:24.307328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:24.359347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a839a-ba87-4203-b932-4afd4e1434f0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:24.393945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:24.394644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:24.394919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:24.395215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:24.396002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:24.396309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:24.397783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940338a8-6bbf-4b9c-8bd5-8c6d44b3f5c1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:24.412841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 656/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 22:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:24.419878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:24.531140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267efc8-c5c3-42ef-855e-b7f4d30b05f5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:24.565304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:24.565947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:24.566222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:24.566496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:24.567364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] RBAC: Adding query filter params (role.id=66993d8e036c40d2809b9b7230ec4195, scope.project.id=80ff00ec694948f38903c2fa3edca2af, user.id=aac86cfdd00a43678c8506217f83ecdf) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:24.567674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:24.569103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6251501-8fc4-43df-881b-a6bd227b8c42 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:24.575036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 631/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 22:28:24 2022] GET /identity/v3/role_assignments?user.id=aac86cfdd00a43678c8506217f83ecdf&scope.project.id=80ff00ec694948f38903c2fa3edca2af&role.id=66993d8e036c40d2809b9b7230ec4195 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:26.598125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7475a-dcba-48ea-aa0f-0866f5c0ee8c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:26.598711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7475a-dcba-48ea-aa0f-0866f5c0ee8c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:26.598711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7475a-dcba-48ea-aa0f-0866f5c0ee8c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:26.600083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 657/1288] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:26.606380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:26.607129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:26.607271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:26.632364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:26.633504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:26.665474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:26.704627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 632/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:26.732601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7475a-dcba-48ea-aa0f-0866f5c0ee8c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:26.840670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7475a-dcba-48ea-aa0f-0866f5c0ee8c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:26.852610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:26.880117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:26.880912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:26.881185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:26.881453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:26.882097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:26.883567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:26.896623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:26.897752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:26.898621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 658/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:28:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:26.906263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:27.010879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600a7c2-c74a-41a5-97a7-cb9ac0cb6afb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:27.046292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:27.046944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:27.047252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:27.047527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:27.048286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:27.048591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:27.049950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef33ffd-5de2-4daa-b3c1-0e6b0cd98c0b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:27.054925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 633/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 22:28:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:27.060883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:27.171412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be51799-c777-4fa4-98e3-922da0d7edf3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:27.211446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:27.212219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:27.212560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:27.212906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:27.213785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:27.214166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:27.216014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9302-7950-4c4f-b67c-3477e86179a3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:27.221523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 659/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 22:28:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:29.200891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cfb67-bb63-48ce-95e2-a127433876a4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:29.201523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cfb67-bb63-48ce-95e2-a127433876a4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:29.201523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cfb67-bb63-48ce-95e2-a127433876a4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:29.202826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 634/1293] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:29.208364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4822665-15ab-445d-95c3-0199cf890ae6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:29.208886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4822665-15ab-445d-95c3-0199cf890ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:29.208886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4822665-15ab-445d-95c3-0199cf890ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:29.226230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c4822665-15ab-445d-95c3-0199cf890ae6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:29.227433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c4822665-15ab-445d-95c3-0199cf890ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:29.260810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:29.304156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 660/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:29.327082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cfb67-bb63-48ce-95e2-a127433876a4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:29.363199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:29.435987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cfb67-bb63-48ce-95e2-a127433876a4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:29.470783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054cbcf-709e-4ab8-8835-0ba0069b017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:29.471473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054cbcf-709e-4ab8-8835-0ba0069b017e None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:29.471754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054cbcf-709e-4ab8-8835-0ba0069b017e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:29.472016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054cbcf-709e-4ab8-8835-0ba0069b017e None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:29.472748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054cbcf-709e-4ab8-8835-0ba0069b017e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:29.474120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054cbcf-709e-4ab8-8835-0ba0069b017e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:29.490800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 635/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 22:28:29 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:28:31.564735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f78b-1788-4480-8ae7-409d6f0e136d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:31.565572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f78b-1788-4480-8ae7-409d6f0e136d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:31.565572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f78b-1788-4480-8ae7-409d6f0e136d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:31.567911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 661/1296] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:31.576622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:31.577049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:31.577216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:31.595751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:31.596977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:31.679285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 636/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:31.702225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f78b-1788-4480-8ae7-409d6f0e136d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:31.816130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f78b-1788-4480-8ae7-409d6f0e136d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:31.854951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:31.856180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:31.856553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:31.856913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:31.857968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:31.860186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:31.879168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:31.880278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:31.881354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 662/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:28:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:31.888977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:31.909933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:32.005218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8551ad-6b16-4cb4-9de1-a2b54f17c8a7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:32.043089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:32.043754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:32.044039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:32.044314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:32.045025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:32.045334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:32.046718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:32.052197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 637/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 22:28:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:28:32.058516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:32.091420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:32.173398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b891c-fdcb-42f6-bb1d-8ccb7044ca0d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:32.211674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:32.212469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:32.212779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:32.213082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:32.214048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] RBAC: Adding query filter params (interface=public, service_id=48c69dead84443329e9f3778a7e1b48b, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:32.214361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:32.216067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75b54-6e5d-4200-a779-de6678ebd4bc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:32.221682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 663/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 22:28:32 2022] GET /identity/v3/endpoints?service_id=48c69dead84443329e9f3778a7e1b48b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:28:32.228167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:32.325894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:32.346930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbad8f-f033-4913-bb29-d8bf88370aaf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:32.394330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72da8f-10a0-49db-af1a-7aa14aa14d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:32.395017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72da8f-10a0-49db-af1a-7aa14aa14d81 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:32.395318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72da8f-10a0-49db-af1a-7aa14aa14d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:32.395594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72da8f-10a0-49db-af1a-7aa14aa14d81 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:32.396284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72da8f-10a0-49db-af1a-7aa14aa14d81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:32.397656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72da8f-10a0-49db-af1a-7aa14aa14d81 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:32.404739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 638/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 22:28:32 2022] GET /identity/v3/services => generated 2191 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:28:34.419967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ea85-83b5-4bfb-9f01-9d2d932762c7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:34.420504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ea85-83b5-4bfb-9f01-9d2d932762c7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:34.420504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ea85-83b5-4bfb-9f01-9d2d932762c7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:34.421913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 664/1302] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:34.427425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:34.427853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:34.427953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:34.446367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:34.447591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:34.517463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 639/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:28:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:28:34.542018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ea85-83b5-4bfb-9f01-9d2d932762c7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:34.641709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:34.652368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ea85-83b5-4bfb-9f01-9d2d932762c7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:34.696559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:34.697380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:34.697661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:34.697933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:34.698583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:34.699985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:28:34.712408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:28:34.713542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 21 22:28:34.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 665/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 22:28:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:28:34.722586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:34.803254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:34.831103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bfbc-15ca-4815-942f-7cb4a25cb46e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:34.866369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:34.867036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:34.867336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:34.867610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:34.868316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:28:34.868623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:34.869995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84df1-ee99-4969-96f1-f85e87e0d53f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:34.875333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 640/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 22:28:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:28:34.882180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:35.001979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae94bd6-1cc0-48d3-82c5-1f75db0fbfc4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:35.044206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12386-65a1-4c32-b5c6-5f2ab892c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:35.044867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12386-65a1-4c32-b5c6-5f2ab892c847 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:35.045144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12386-65a1-4c32-b5c6-5f2ab892c847 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:35.045414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12386-65a1-4c32-b5c6-5f2ab892c847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:35.046161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12386-65a1-4c32-b5c6-5f2ab892c847 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:35.047614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12386-65a1-4c32-b5c6-5f2ab892c847 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:35.072070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 666/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 22:28:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:28:44.872128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=30 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:45.066889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:38.172936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8a0df-bbab-4362-80fa-bfa3642e0e6b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.173525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8a0df-bbab-4362-80fa-bfa3642e0e6b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.173525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8a0df-bbab-4362-80fa-bfa3642e0e6b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.180490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0617-2ed1-46b0-9077-b579779ca554 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.181015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0617-2ed1-46b0-9077-b579779ca554 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.181015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e0617-2ed1-46b0-9077-b579779ca554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.184548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 641/1307] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:38 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:38.257200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d83e0617-2ed1-46b0-9077-b579779ca554 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:38.258328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d83e0617-2ed1-46b0-9077-b579779ca554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.385514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 667/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:29:38.438775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693e14-d9d2-416f-a0da-b081a1b515ec None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.439580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693e14-d9d2-416f-a0da-b081a1b515ec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.440995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693e14-d9d2-416f-a0da-b081a1b515ec None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.446609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 642/1309] 10.222.0.20 () {54 vars in 965 bytes} [Thu Jul 21 22:29:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:38.453471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8078c82-ff68-4abe-8504-2406771893ae None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.453708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8078c82-ff68-4abe-8504-2406771893ae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.453998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8078c82-ff68-4abe-8504-2406771893ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.566715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a8078c82-ff68-4abe-8504-2406771893ae None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:38.568862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a8078c82-ff68-4abe-8504-2406771893ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.592020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:38.663982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 668/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:38.672436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693e14-d9d2-416f-a0da-b081a1b515ec None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:38.674185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-18693e14-d9d2-416f-a0da-b081a1b515ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.794520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693e14-d9d2-416f-a0da-b081a1b515ec None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:38.872282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:38.872863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.873143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.873414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.875077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.931362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:38.991560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:38.993177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133eda-1ba0-4a2d-b72a-032ecc7b37d8 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.015061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 643/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:41.350389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670232d6-975f-4a3f-9dc9-8ff9928491a7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.351010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670232d6-975f-4a3f-9dc9-8ff9928491a7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.351010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670232d6-975f-4a3f-9dc9-8ff9928491a7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.352385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 669/1312] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:41.357794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cf28-14e3-4ca6-abe9-bc31045e7df5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.358229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cf28-14e3-4ca6-abe9-bc31045e7df5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.358335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cf28-14e3-4ca6-abe9-bc31045e7df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.443992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2737cf28-14e3-4ca6-abe9-bc31045e7df5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.445230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2737cf28-14e3-4ca6-abe9-bc31045e7df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.545304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 644/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.594887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6950b-18c4-4080-a8a6-a729ea25dc67 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.595180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6950b-18c4-4080-a8a6-a729ea25dc67 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.595455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6950b-18c4-4080-a8a6-a729ea25dc67 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.597012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 670/1314] 10.222.0.20 () {54 vars in 965 bytes} [Thu Jul 21 22:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:41.602898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4ba9-0ccf-40b4-9a8c-65c319258bed None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.603129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4ba9-0ccf-40b4-9a8c-65c319258bed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.603420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4ba9-0ccf-40b4-9a8c-65c319258bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.614139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:41.683703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e5da4ba9-0ccf-40b4-9a8c-65c319258bed None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.684998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e5da4ba9-0ccf-40b4-9a8c-65c319258bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.766890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 645/1315] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.776529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6950b-18c4-4080-a8a6-a729ea25dc67 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.778093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-87f6950b-18c4-4080-a8a6-a729ea25dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.892080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6950b-18c4-4080-a8a6-a729ea25dc67 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.967693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:41.970111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.970739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.971042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.971378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.973373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:42.084991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.086448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704394-4879-484b-a449-8dc92afd252a service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.104930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 671/1316] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:44.641213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62053-1379-46a9-b1e8-e3b07a1b2526 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.641821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62053-1379-46a9-b1e8-e3b07a1b2526 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.641821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62053-1379-46a9-b1e8-e3b07a1b2526 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.643174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 646/1317] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:44.649053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ad4c7-5352-4f24-bc8d-5d13285b7375 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.649445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ad4c7-5352-4f24-bc8d-5d13285b7375 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.649610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ad4c7-5352-4f24-bc8d-5d13285b7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.717285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b9ad4c7-5352-4f24-bc8d-5d13285b7375 None None] MFA Rules not processed for user `f9dbca93f4b04d93985c947947b1a2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:44.718521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b9ad4c7-5352-4f24-bc8d-5d13285b7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:44.772293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:44.818385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 672/1318] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:44.860642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62053-1379-46a9-b1e8-e3b07a1b2526 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:44.862192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5ea62053-1379-46a9-b1e8-e3b07a1b2526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:44.970663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62053-1379-46a9-b1e8-e3b07a1b2526 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:44.973681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:45.051967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:45.052621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:45.052896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:45.053164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:45.054790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:45.164899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:45.166352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9d03b-26df-4d14-8359-26f281036818 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:45.185990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 647/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:47.886709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74410ec-9fd5-466a-8201-e25e641b00be None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:47.887337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74410ec-9fd5-466a-8201-e25e641b00be None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:47.887337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74410ec-9fd5-466a-8201-e25e641b00be None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:47.888710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 673/1320] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:47.894486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53913-1c84-468e-b84a-145696657fb2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:47.894933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53913-1c84-468e-b84a-145696657fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:47.895068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53913-1c84-468e-b84a-145696657fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:47.936303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:47.962222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cda53913-1c84-468e-b84a-145696657fb2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:47.963484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cda53913-1c84-468e-b84a-145696657fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:48.064322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 648/1321] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:48.103677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74410ec-9fd5-466a-8201-e25e641b00be None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:48.105258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f74410ec-9fd5-466a-8201-e25e641b00be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:48.215467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74410ec-9fd5-466a-8201-e25e641b00be None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:48.290148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:48.290795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:48.291108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:48.291380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:48.293036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:48.300827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:48.414001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:48.415404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c613df-3b2c-42c8-a8ca-c2da25505155 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:48.435224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 674/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:51.173684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90461410-f3bc-4e0a-86c5-53bffddf618b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:51.174254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90461410-f3bc-4e0a-86c5-53bffddf618b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:51.174254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90461410-f3bc-4e0a-86c5-53bffddf618b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.176061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 649/1323] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:51.181914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9076f-7e0f-4cc5-a1d5-07276dc0fa93 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:51.182418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9076f-7e0f-4cc5-a1d5-07276dc0fa93 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:51.182511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9076f-7e0f-4cc5-a1d5-07276dc0fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.248089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9da9076f-7e0f-4cc5-a1d5-07276dc0fa93 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:51.249295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9da9076f-7e0f-4cc5-a1d5-07276dc0fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.308962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:51.356230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 675/1324] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:51.392462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90461410-f3bc-4e0a-86c5-53bffddf618b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:51.394446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-90461410-f3bc-4e0a-86c5-53bffddf618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.509670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90461410-f3bc-4e0a-86c5-53bffddf618b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:51.523194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:51.586374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:51.587026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:51.587342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:51.587734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.589438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.702147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:51.703661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24deee-ac77-4019-a724-1ab159541f5d service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:51.722976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 650/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:53.789529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e542d-164c-498c-874b-bb0eb0b013af None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.790064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e542d-164c-498c-874b-bb0eb0b013af None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.790064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e542d-164c-498c-874b-bb0eb0b013af None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.791557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 676/1326] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:53.797103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e689e1f-67b6-4ccd-bada-63daf3cafca8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.797562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e689e1f-67b6-4ccd-bada-63daf3cafca8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.797683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e689e1f-67b6-4ccd-bada-63daf3cafca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.846321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:53.868199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2e689e1f-67b6-4ccd-bada-63daf3cafca8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:53.869705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2e689e1f-67b6-4ccd-bada-63daf3cafca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:53.971273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 651/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:54.007486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e542d-164c-498c-874b-bb0eb0b013af None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:54.009031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7f8e542d-164c-498c-874b-bb0eb0b013af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.114732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e542d-164c-498c-874b-bb0eb0b013af None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:54.195548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:54.196205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.196444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.196740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.198426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.220066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:54.314240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:54.315778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef7cea-8cab-47bd-98f2-643da9cd8440 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:54.334299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 677/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:56.415538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958c41-7633-4336-a7dc-1af8cbdebcb5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.416086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958c41-7633-4336-a7dc-1af8cbdebcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.416086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958c41-7633-4336-a7dc-1af8cbdebcb5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.417551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 652/1329] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:56.422845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa92068-2f39-46ea-9fbb-f2767828d6ff None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.423308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa92068-2f39-46ea-9fbb-f2767828d6ff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.423400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa92068-2f39-46ea-9fbb-f2767828d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.492655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8aa92068-2f39-46ea-9fbb-f2767828d6ff None None] MFA Rules not processed for user `f9dbca93f4b04d93985c947947b1a2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:56.493876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8aa92068-2f39-46ea-9fbb-f2767828d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.568892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:56.602073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 678/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:56.640009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958c41-7633-4336-a7dc-1af8cbdebcb5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:56.641683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-13958c41-7633-4336-a7dc-1af8cbdebcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.756288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958c41-7633-4336-a7dc-1af8cbdebcb5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:56.778530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:56.833085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:56.833749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.834026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.834291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.836016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.963903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:56.965436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102fe90-fed8-40a4-a871-ed4b0e923ffa service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:56.984804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 653/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:59.411449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb15b2-083c-4376-93ee-566bab6e4b06 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.411955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb15b2-083c-4376-93ee-566bab6e4b06 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.411955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb15b2-083c-4376-93ee-566bab6e4b06 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.413386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 679/1332] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:59.419746 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2a40-b517-4f9f-a945-656b23bab0e1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.420503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2a40-b517-4f9f-a945-656b23bab0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.420638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2a40-b517-4f9f-a945-656b23bab0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.499271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:59.503203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6a5a2a40-b517-4f9f-a945-656b23bab0e1 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:59.505435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6a5a2a40-b517-4f9f-a945-656b23bab0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:59.608395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 654/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:59.646617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb15b2-083c-4376-93ee-566bab6e4b06 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.648203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-84eb15b2-083c-4376-93ee-566bab6e4b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:59.759882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb15b2-083c-4376-93ee-566bab6e4b06 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.835048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.835721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.835999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.836267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.837871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:59.864512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:59.949316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.950666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315da2b-d9f4-44a5-a146-57e8eb226b4c service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.968863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 680/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:02.044853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f556a7-2d90-4a52-9111-9a4a61628c32 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.045960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f556a7-2d90-4a52-9111-9a4a61628c32 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.045960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f556a7-2d90-4a52-9111-9a4a61628c32 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.047723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 655/1335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:02.054901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb3d7-4d3b-4e20-b121-c75e7379bd41 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.055358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb3d7-4d3b-4e20-b121-c75e7379bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.055464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb3d7-4d3b-4e20-b121-c75e7379bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.121257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-25aeb3d7-4d3b-4e20-b121-c75e7379bd41 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:02.122451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-25aeb3d7-4d3b-4e20-b121-c75e7379bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:02.209546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:02.233207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 681/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:02.273559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f556a7-2d90-4a52-9111-9a4a61628c32 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.275139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-85f556a7-2d90-4a52-9111-9a4a61628c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:02.391414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f556a7-2d90-4a52-9111-9a4a61628c32 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.420896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:02.469083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.469726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.470003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.470269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.471928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:02.592848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.595338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e452c8-a4e7-4a8f-8e63-eebefb6980b5 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.619895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 656/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:05.102935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155a933-fb62-4700-be9f-39783be2b3e1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:05.103571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155a933-fb62-4700-be9f-39783be2b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:05.103571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155a933-fb62-4700-be9f-39783be2b3e1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:05.104930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 682/1338] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:05.111334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee3c2-2080-4038-ace8-70fe559ed586 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:05.112053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee3c2-2080-4038-ace8-70fe559ed586 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:05.112217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee3c2-2080-4038-ace8-70fe559ed586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:05.186778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d2eee3c2-2080-4038-ace8-70fe559ed586 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:05.188028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d2eee3c2-2080-4038-ace8-70fe559ed586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:05.197137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:05.292819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 657/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:05.332447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155a933-fb62-4700-be9f-39783be2b3e1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:05.334832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5155a933-fb62-4700-be9f-39783be2b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:05.440518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155a933-fb62-4700-be9f-39783be2b3e1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:05.517815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:05.518479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:05.518759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:05.519103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:05.521120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:05.557732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:05.642407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:05.643818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ebfd7-075f-4250-9dca-a19fe7ac61f8 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:05.662603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 683/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:09.813529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96f9f-9f6e-4c4d-9df8-059a4bd33ea1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.814061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96f9f-9f6e-4c4d-9df8-059a4bd33ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.814061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc96f9f-9f6e-4c4d-9df8-059a4bd33ea1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:09.815427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 658/1341] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:09.821004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998abd0-c6d5-45d8-8ce2-49c4bd9d5fd5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.821481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998abd0-c6d5-45d8-8ce2-49c4bd9d5fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.821575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998abd0-c6d5-45d8-8ce2-49c4bd9d5fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:09.887559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4998abd0-c6d5-45d8-8ce2-49c4bd9d5fd5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:09.888753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4998abd0-c6d5-45d8-8ce2-49c4bd9d5fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:09.978461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:09.991371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 684/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:10.037811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96f9f-9f6e-4c4d-9df8-059a4bd33ea1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:10.039722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abc96f9f-9f6e-4c4d-9df8-059a4bd33ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:10.159850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc96f9f-9f6e-4c4d-9df8-059a4bd33ea1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:10.213948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:10.255882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:10.256653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:10.256932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:10.257217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:10.258868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:10.374343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:10.376145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694c659-7f8a-43d2-9abf-e8987cae0cea service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:10.396823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 659/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:13.027678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07671978-6af1-4774-85e0-ad7a53fc12c9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:13.028236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07671978-6af1-4774-85e0-ad7a53fc12c9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:13.028236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07671978-6af1-4774-85e0-ad7a53fc12c9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:13.029824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 685/1344] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:13.035445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977d2e8-7e4d-468c-b28a-96c7223361a0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:13.036017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977d2e8-7e4d-468c-b28a-96c7223361a0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:13.036017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977d2e8-7e4d-468c-b28a-96c7223361a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:13.102328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8977d2e8-7e4d-468c-b28a-96c7223361a0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:13.103563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8977d2e8-7e4d-468c-b28a-96c7223361a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:13.122388 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:13.209895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 660/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:13.247872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07671978-6af1-4774-85e0-ad7a53fc12c9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:13.249431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-07671978-6af1-4774-85e0-ad7a53fc12c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:13.354870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07671978-6af1-4774-85e0-ad7a53fc12c9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:13.431502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:13.432162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:13.432439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:13.432722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:13.434365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:13.478287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:13.550944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:13.552463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abd726-cbf5-4ae7-b131-2caadafacc31 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:13.572363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 686/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:17.597721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a59e-84cc-450a-b476-6d878f066bd0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.598276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a59e-84cc-450a-b476-6d878f066bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.598276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a59e-84cc-450a-b476-6d878f066bd0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.599696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 661/1347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:17.605023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e85a-003d-437c-9445-779919f25b28 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.605492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e85a-003d-437c-9445-779919f25b28 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.605791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e85a-003d-437c-9445-779919f25b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.696927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9d59e85a-003d-437c-9445-779919f25b28 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:17.699363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9d59e85a-003d-437c-9445-779919f25b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.804368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:17.807585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 687/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:17.845443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a59e-84cc-450a-b476-6d878f066bd0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:17.847031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c387a59e-84cc-450a-b476-6d878f066bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.956850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a59e-84cc-450a-b476-6d878f066bd0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:18.010142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:18.038842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:18.039552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:18.039824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:18.040094 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:18.041788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:18.159202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:18.160690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f46f6-8274-43e7-9289-371dd16cdc20 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:18.180512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 662/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:23.234135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685fa5b-a9b4-4eb5-939f-3874f302743c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.234763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685fa5b-a9b4-4eb5-939f-3874f302743c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.235354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685fa5b-a9b4-4eb5-939f-3874f302743c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.238728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 688/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:30:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:23.246194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6887-2a34-4089-8141-865cbb727331 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.246785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6887-2a34-4089-8141-865cbb727331 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.249704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a6887-2a34-4089-8141-865cbb727331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.382747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ae7a6887-2a34-4089-8141-865cbb727331 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:23.384042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ae7a6887-2a34-4089-8141-865cbb727331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.413965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:23.588626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 663/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:27.827692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d820e-db08-4a0b-a55e-db5fdd111899 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:27.828293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d820e-db08-4a0b-a55e-db5fdd111899 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:27.828424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d820e-db08-4a0b-a55e-db5fdd111899 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:27.830281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 689/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:27.835549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6af370-365b-42a3-80fe-29bf4ab191a9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:27.836446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6af370-365b-42a3-80fe-29bf4ab191a9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:27.836943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6af370-365b-42a3-80fe-29bf4ab191a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:27.922508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8f6af370-365b-42a3-80fe-29bf4ab191a9 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:27.924357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8f6af370-365b-42a3-80fe-29bf4ab191a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:28.008621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:28.047035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 664/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:30:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:29.538164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199440-6440-498f-ac88-b031645c2bf7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:29.538721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199440-6440-498f-ac88-b031645c2bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:29.538721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba199440-6440-498f-ac88-b031645c2bf7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:29.540288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 690/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:29.545176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbda66d-f969-41d9-8c8d-27dadec06809 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:29.545596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbda66d-f969-41d9-8c8d-27dadec06809 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:29.545855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbda66d-f969-41d9-8c8d-27dadec06809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:29.626826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6dbda66d-f969-41d9-8c8d-27dadec06809 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:29.628221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6dbda66d-f969-41d9-8c8d-27dadec06809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:29.746160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 665/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:30:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:32.991036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c9d1f-69fd-420e-9045-bd757afde615 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.991036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c9d1f-69fd-420e-9045-bd757afde615 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.991771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c9d1f-69fd-420e-9045-bd757afde615 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.992875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 691/1356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:32.998729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61a6a-d747-4cc4-b5a9-e619a0cc46b6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.999337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61a6a-d747-4cc4-b5a9-e619a0cc46b6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.999337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61a6a-d747-4cc4-b5a9-e619a0cc46b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.047561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:33.099700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5fd61a6a-d747-4cc4-b5a9-e619a0cc46b6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:33.101107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5fd61a6a-d747-4cc4-b5a9-e619a0cc46b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.215497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 666/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:33.269689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8193628-2bf9-40b6-83ee-8e94dbd84749 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.270507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8193628-2bf9-40b6-83ee-8e94dbd84749 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.270622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8193628-2bf9-40b6-83ee-8e94dbd84749 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.272004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 692/1358] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 22:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:30:33.279391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93d44-161c-4fe3-9995-a7c3a8003246 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.279720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93d44-161c-4fe3-9995-a7c3a8003246 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.280004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda93d44-161c-4fe3-9995-a7c3a8003246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.364839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cda93d44-161c-4fe3-9995-a7c3a8003246 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:33.366194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cda93d44-161c-4fe3-9995-a7c3a8003246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.424604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:33.495962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 667/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 22:30:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:33.504133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8193628-2bf9-40b6-83ee-8e94dbd84749 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.506040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a8193628-2bf9-40b6-83ee-8e94dbd84749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.665541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8193628-2bf9-40b6-83ee-8e94dbd84749 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:33.748110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:33.786321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.787000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.787290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.787611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.789284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.885648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.887296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaab1f-1a50-4265-a29e-12cd7ba01ec4 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:33.907270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 693/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:36.142721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505259f-1411-43f4-a355-14ae552e6a20 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.143220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505259f-1411-43f4-a355-14ae552e6a20 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.143297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505259f-1411-43f4-a355-14ae552e6a20 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.149119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 668/1361] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:36.150921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf5399-08bb-436b-9083-1d6b52e4f558 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.151454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf5399-08bb-436b-9083-1d6b52e4f558 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.151841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf5399-08bb-436b-9083-1d6b52e4f558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.234397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-89bf5399-08bb-436b-9083-1d6b52e4f558 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:36.235648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89bf5399-08bb-436b-9083-1d6b52e4f558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.278684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:36.351073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 694/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:36.395718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505259f-1411-43f4-a355-14ae552e6a20 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:36.397276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8505259f-1411-43f4-a355-14ae552e6a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.571607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505259f-1411-43f4-a355-14ae552e6a20 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:36.583998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:36.745675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:36.746369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.746755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.760760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.762723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.874776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:36.877672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92a821-c56e-4236-87c1-e925d396510b service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:36.898662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 669/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:39.426911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219781a9-93a8-4716-bc37-6642ad003abd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.427494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219781a9-93a8-4716-bc37-6642ad003abd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.427590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219781a9-93a8-4716-bc37-6642ad003abd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.429620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 695/1364] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:39.435046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ee71-b411-4334-9d7f-80d474a84195 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.435046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ee71-b411-4334-9d7f-80d474a84195 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.436219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ee71-b411-4334-9d7f-80d474a84195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.459567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:39.541851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3836ee71-b411-4334-9d7f-80d474a84195 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:39.543370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3836ee71-b411-4334-9d7f-80d474a84195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:39.683081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 670/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:39.740900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990bc1a-7377-4eb6-a4e8-3a136acca25d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.741238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990bc1a-7377-4eb6-a4e8-3a136acca25d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.741579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990bc1a-7377-4eb6-a4e8-3a136acca25d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.743031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 696/1366] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 22:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:39.749651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9f569-f8f6-491c-8ee3-958f301b0665 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.749936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9f569-f8f6-491c-8ee3-958f301b0665 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.750215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9f569-f8f6-491c-8ee3-958f301b0665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.838485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-59c9f569-f8f6-491c-8ee3-958f301b0665 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:39.840648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-59c9f569-f8f6-491c-8ee3-958f301b0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:39.881363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:40.010717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990bc1a-7377-4eb6-a4e8-3a136acca25d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.012676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8990bc1a-7377-4eb6-a4e8-3a136acca25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:40.023172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 671/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 22:30:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:40.203297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990bc1a-7377-4eb6-a4e8-3a136acca25d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.229503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:40.337779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.338748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.339219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.339769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.341990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:40.462737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.464616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b4a9f-6854-4e38-8f13-9fed0a9b9fe8 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.484543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 697/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:41.445849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b660-fe6a-47b8-9bb0-0e0d5f5326eb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.446392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b660-fe6a-47b8-9bb0-0e0d5f5326eb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.446392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88b660-fe6a-47b8-9bb0-0e0d5f5326eb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.452925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 672/1369] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:41.453835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec98e3a-0e1f-4baa-ad2f-325b98cdf66c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.454204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec98e3a-0e1f-4baa-ad2f-325b98cdf66c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.454485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec98e3a-0e1f-4baa-ad2f-325b98cdf66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.492811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:41.531148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8ec98e3a-0e1f-4baa-ad2f-325b98cdf66c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:41.532442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8ec98e3a-0e1f-4baa-ad2f-325b98cdf66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:41.643531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 698/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:41.952842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd94d1-36ed-46ff-b313-df9378e54630 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.953177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd94d1-36ed-46ff-b313-df9378e54630 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.953395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd94d1-36ed-46ff-b313-df9378e54630 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.955237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 673/1371] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jul 21 22:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:41.961508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9aa6-30c8-4cce-ac8c-5ea31d3910c5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.961819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9aa6-30c8-4cce-ac8c-5ea31d3910c5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.962096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9aa6-30c8-4cce-ac8c-5ea31d3910c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.075133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c4fe9aa6-30c8-4cce-ac8c-5ea31d3910c5 None None] MFA Rules not processed for user `a0861b19130e41e39a57a61c8972336f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:42.076697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c4fe9aa6-30c8-4cce-ac8c-5ea31d3910c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.139401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:42.171252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 699/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:42.179428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd94d1-36ed-46ff-b313-df9378e54630 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.181301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-72bd94d1-36ed-46ff-b313-df9378e54630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.320098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd94d1-36ed-46ff-b313-df9378e54630 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.365368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:42.416865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.417550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.417835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.418110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.420298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.551729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.553216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6a6e-d119-4cad-87d1-9a836bd9b705 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.583277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 674/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:42.718335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111245f-c207-4f34-8ac3-3157e5c8da45 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.718878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111245f-c207-4f34-8ac3-3157e5c8da45 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.718878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111245f-c207-4f34-8ac3-3157e5c8da45 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.721395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 700/1374] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:42.730094 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4141d9c-89f8-49bc-92ee-3ce9b01354fb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.730408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4141d9c-89f8-49bc-92ee-3ce9b01354fb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.730687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4141d9c-89f8-49bc-92ee-3ce9b01354fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.838717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a4141d9c-89f8-49bc-92ee-3ce9b01354fb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:42.841247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a4141d9c-89f8-49bc-92ee-3ce9b01354fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.880541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:43.002288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 675/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:43.051449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111245f-c207-4f34-8ac3-3157e5c8da45 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.053205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e111245f-c207-4f34-8ac3-3157e5c8da45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.265346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111245f-c207-4f34-8ac3-3157e5c8da45 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.325289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:43.405544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.405544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.406488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.406488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.408453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.501571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.503432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e82fe-ed58-49e8-a199-4779c6104641 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.525336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 701/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:45.656995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ebddb-0658-48c2-aea3-09be0ed16de6 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.657483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ebddb-0658-48c2-aea3-09be0ed16de6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.657483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ebddb-0658-48c2-aea3-09be0ed16de6 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.659077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 676/1377] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:45.664958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702841-7005-433e-a593-27aca15cc101 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.665425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702841-7005-433e-a593-27aca15cc101 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.665520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702841-7005-433e-a593-27aca15cc101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.741368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f4702841-7005-433e-a593-27aca15cc101 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:45.742658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f4702841-7005-433e-a593-27aca15cc101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:45.749883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:45.869997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 702/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:45.933214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ebddb-0658-48c2-aea3-09be0ed16de6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:45.933214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2c6ebddb-0658-48c2-aea3-09be0ed16de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.074623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ebddb-0658-48c2-aea3-09be0ed16de6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.078337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.200703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.201365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.201653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.201921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.203705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.340978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.345040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512ec8a-5ab9-46b0-b548-ffebd89cacd2 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.375248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 677/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:48.502493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e165c-bba3-4604-8279-d391c49268af None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:48.503255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e165c-bba3-4604-8279-d391c49268af None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:48.503255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e165c-bba3-4604-8279-d391c49268af None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:48.504786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 703/1380] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:48.510549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e999a-ff47-4519-ad7a-c40dd52ef2f3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:48.511164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e999a-ff47-4519-ad7a-c40dd52ef2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:48.511164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e999a-ff47-4519-ad7a-c40dd52ef2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:48.522032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:48.581304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1c4e999a-ff47-4519-ad7a-c40dd52ef2f3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:48.582539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c4e999a-ff47-4519-ad7a-c40dd52ef2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:48.683769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 678/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:48.728429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e165c-bba3-4604-8279-d391c49268af None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:48.730135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-202e165c-bba3-4604-8279-d391c49268af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:48.888508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:48.900327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e165c-bba3-4604-8279-d391c49268af None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.027679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.028341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.028617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.028882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.030773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.125788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.127573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a21365-705e-4098-9022-0daf47618d47 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.139368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:49.150024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 704/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:51.216293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826837-446f-4393-91eb-0bf8ddf41fd2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.216891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826837-446f-4393-91eb-0bf8ddf41fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.216891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826837-446f-4393-91eb-0bf8ddf41fd2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.218432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 679/1383] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:51.224253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2128f-2b7a-455c-9e1a-4713d5a3d723 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.224676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2128f-2b7a-455c-9e1a-4713d5a3d723 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.224837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2128f-2b7a-455c-9e1a-4713d5a3d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.299535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-28f2128f-2b7a-455c-9e1a-4713d5a3d723 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:51.300798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28f2128f-2b7a-455c-9e1a-4713d5a3d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.412057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 705/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:51.457184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826837-446f-4393-91eb-0bf8ddf41fd2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.458954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f2826837-446f-4393-91eb-0bf8ddf41fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.552511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:51.622521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826837-446f-4393-91eb-0bf8ddf41fd2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.750982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.751696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.751990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.752271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.754136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.815976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:51.860100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.861799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586cb98-daf9-4a3c-bd50-eb33d852fbe0 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.881187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 680/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:54.059136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9475db-3692-4d39-96d4-597479e94110 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.059745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9475db-3692-4d39-96d4-597479e94110 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.059745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9475db-3692-4d39-96d4-597479e94110 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.061175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 706/1386] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:54.067087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b070c-9e86-4879-b8b3-42d9be6101d1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.067699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b070c-9e86-4879-b8b3-42d9be6101d1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.067699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b070c-9e86-4879-b8b3-42d9be6101d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.137052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8b3b070c-9e86-4879-b8b3-42d9be6101d1 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:54.138340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8b3b070c-9e86-4879-b8b3-42d9be6101d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:54.264935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 681/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:54.322516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9475db-3692-4d39-96d4-597479e94110 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:54.324481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4f9475db-3692-4d39-96d4-597479e94110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:54.413828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:54.492966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9475db-3692-4d39-96d4-597479e94110 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:54.628979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:54.629606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.629885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.630156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.631985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:54.678244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:54.744736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:54.747120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc432673-adff-41d4-a888-076e3e9ee003 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:54.783024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 707/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:56.963702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a7f92-3e04-4dd4-8c7e-dd9450213dab None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.964274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a7f92-3e04-4dd4-8c7e-dd9450213dab None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.964274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a7f92-3e04-4dd4-8c7e-dd9450213dab None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.965652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 682/1389] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:56.971142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aff8e6-1559-41c2-b988-8e24c2b4c2b9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.971587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aff8e6-1559-41c2-b988-8e24c2b4c2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.971693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aff8e6-1559-41c2-b988-8e24c2b4c2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.036233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-10aff8e6-1559-41c2-b988-8e24c2b4c2b9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:57.037438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-10aff8e6-1559-41c2-b988-8e24c2b4c2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.145356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 708/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:57.191498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a7f92-3e04-4dd4-8c7e-dd9450213dab None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.193143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-033a7f92-3e04-4dd4-8c7e-dd9450213dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.224620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.341968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a7f92-3e04-4dd4-8c7e-dd9450213dab None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.456263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.471232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.471901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.472178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.472452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.474101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.576815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.578351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe43a-9cb0-4776-9af1-32e54425a80a service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.597355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 683/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:58.096482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6de5-e8a9-40d9-915f-52dd98ab2da6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.097053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6de5-e8a9-40d9-915f-52dd98ab2da6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.097053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6de5-e8a9-40d9-915f-52dd98ab2da6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.098915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 709/1392] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:58.104093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234536-71dd-47a9-a1d1-f72fb372013a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.104632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234536-71dd-47a9-a1d1-f72fb372013a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.104632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec234536-71dd-47a9-a1d1-f72fb372013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.172773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ec234536-71dd-47a9-a1d1-f72fb372013a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:58.173992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ec234536-71dd-47a9-a1d1-f72fb372013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.241598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.286781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 684/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:58.354186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545a4c-cc39-4690-96ec-135375af0933 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.354470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545a4c-cc39-4690-96ec-135375af0933 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.354820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545a4c-cc39-4690-96ec-135375af0933 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.356323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 710/1394] 10.222.0.20 () {54 vars in 966 bytes} [Thu Jul 21 22:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:58.361767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d51e3-58bf-49f6-8b40-22a3de60f527 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.362058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d51e3-58bf-49f6-8b40-22a3de60f527 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.362331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d51e3-58bf-49f6-8b40-22a3de60f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.442964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-627d51e3-58bf-49f6-8b40-22a3de60f527 None None] MFA Rules not processed for user `5b5e5657f0c243feaae1824559d6f816`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:58.444210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-627d51e3-58bf-49f6-8b40-22a3de60f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.529231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 685/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:58.536900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545a4c-cc39-4690-96ec-135375af0933 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.538422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e545a4c-cc39-4690-96ec-135375af0933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.552622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.659205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545a4c-cc39-4690-96ec-135375af0933 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.733899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.734564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.734840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.735144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.736784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.807392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.848490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.849951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdba91-9c31-46f0-acd5-2f69b387097b service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.867998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 711/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:59.592679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0464f-78a6-47d6-8d41-6cadc76a4d26 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.593173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0464f-78a6-47d6-8d41-6cadc76a4d26 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.593336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0464f-78a6-47d6-8d41-6cadc76a4d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.664546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dbc0464f-78a6-47d6-8d41-6cadc76a4d26 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:59.666127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dbc0464f-78a6-47d6-8d41-6cadc76a4d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:59.681364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:59.682456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17a541-e092-496a-952c-43641196af65 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.682921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17a541-e092-496a-952c-43641196af65 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.683089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17a541-e092-496a-952c-43641196af65 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.684563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 712/1397] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:59.689763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.690098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.690488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.761749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:59.763055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:59.794915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 686/1398] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:59.846151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9832ff8-01a3-43c3-9750-20969bbea68d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.846549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9832ff8-01a3-43c3-9750-20969bbea68d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.846897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9832ff8-01a3-43c3-9750-20969bbea68d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.848798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 687/1399] 10.222.0.20 () {54 vars in 943 bytes} [Thu Jul 21 22:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:30:59.854960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.855288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.855638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.875634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 713/1400] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:59.923130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.924378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:59.949993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:59.954330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] MFA Rules not processed for user `d298476d65ba4329b5aea924e7fd5f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:59.955652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.041620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:00.045518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef8a8-7e7a-44a5-a29f-ac822e1db56a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.069732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 688/1401] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Jul 21 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:00.079355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.089256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dce25-79ed-4037-b31f-7bb2ff3f9750 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.176342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.177008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.177290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.177555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.179253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.197356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.198026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.198310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.198584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.199341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:00.200356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.273984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.275650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9ae8f-dca0-4cf2-b462-1e530427e10c service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.288569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.290278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c66355-4cdd-4ee9-a1d1-c4dc35d64a3f service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.297593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 714/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:00.298706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 689/1403] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:31:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:02.480384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866278d-57f1-4dda-abaf-25addafe780e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.481009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866278d-57f1-4dda-abaf-25addafe780e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.481009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866278d-57f1-4dda-abaf-25addafe780e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.482490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 715/1404] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:02.488066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264504-247a-4b15-94fb-44dd91a8452f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.489232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264504-247a-4b15-94fb-44dd91a8452f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.489515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264504-247a-4b15-94fb-44dd91a8452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.500417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:02.568272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e4264504-247a-4b15-94fb-44dd91a8452f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:02.570224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e4264504-247a-4b15-94fb-44dd91a8452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.683104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 690/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:02.734046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866278d-57f1-4dda-abaf-25addafe780e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.735611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8866278d-57f1-4dda-abaf-25addafe780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.892592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:02.894209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866278d-57f1-4dda-abaf-25addafe780e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.029224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.030151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.030585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.031048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.033009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.143928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.145874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cd715-596e-44fd-804d-78ba8a54d8f1 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.169433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 716/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:05.243610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6f32-6e39-43cc-aecf-9712e2ac38f3 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.244135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6f32-6e39-43cc-aecf-9712e2ac38f3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.244135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6f32-6e39-43cc-aecf-9712e2ac38f3 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.245596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 691/1407] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:05.250850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefd159-6a08-4453-a441-17d44b21d94a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.251363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefd159-6a08-4453-a441-17d44b21d94a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.251479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefd159-6a08-4453-a441-17d44b21d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.255045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:05.327671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1eefd159-6a08-4453-a441-17d44b21d94a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:05.329055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1eefd159-6a08-4453-a441-17d44b21d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:05.436088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 717/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:05.481053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d6f32-6e39-43cc-aecf-9712e2ac38f3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.482864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-181d6f32-6e39-43cc-aecf-9712e2ac38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:05.576751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:05.641861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d6f32-6e39-43cc-aecf-9712e2ac38f3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.763007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.764145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.764428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.764701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.766404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:05.876925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:05.938276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.939985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f754f1-aaf8-4aea-8527-2fdca07f743b service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.963730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 692/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:15.434304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=64 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:15.960907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=23 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:22.284895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3bcf-6a3f-42de-b2ad-10683090baee None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:22.285496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3bcf-6a3f-42de-b2ad-10683090baee None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:22.285496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3bcf-6a3f-42de-b2ad-10683090baee None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:22.286831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 718/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jul 21 22:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:22.292607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b41ba7-d29d-4214-8f55-42d5f0b1ff83 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:22.293141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b41ba7-d29d-4214-8f55-42d5f0b1ff83 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:22.293141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b41ba7-d29d-4214-8f55-42d5f0b1ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:22.372057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-25b41ba7-d29d-4214-8f55-42d5f0b1ff83 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:22.373236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-25b41ba7-d29d-4214-8f55-42d5f0b1ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:22.616029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 693/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jul 21 22:31:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:22.631102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7379c-f659-4ab4-8a93-55282cc34700 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:22.631416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7379c-f659-4ab4-8a93-55282cc34700 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:22.631690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7379c-f659-4ab4-8a93-55282cc34700 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:22.633068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 719/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jul 21 22:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:22.639482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b0d0-5137-495c-a5f0-7fbd6cae5ae2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:22.639933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b0d0-5137-495c-a5f0-7fbd6cae5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:22.640376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b0d0-5137-495c-a5f0-7fbd6cae5ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:22.745180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:22.748198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1ec4b0d0-5137-495c-a5f0-7fbd6cae5ae2 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:22.749523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ec4b0d0-5137-495c-a5f0-7fbd6cae5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:22.872407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 694/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jul 21 22:31:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:25.441026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4d72-0e23-4adb-8b6a-fd23cea95c65 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:25.441605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4d72-0e23-4adb-8b6a-fd23cea95c65 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:25.441605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef4d72-0e23-4adb-8b6a-fd23cea95c65 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:25.443169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:25.451789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aecae-4181-40e3-96d4-f7eec8667a70 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:25.452324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aecae-4181-40e3-96d4-f7eec8667a70 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:25.452482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aecae-4181-40e3-96d4-f7eec8667a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:25.541609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-be7aecae-4181-40e3-96d4-f7eec8667a70 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:25.543405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be7aecae-4181-40e3-96d4-f7eec8667a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:25.616780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:25.676829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:25.724496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4d72-0e23-4adb-8b6a-fd23cea95c65 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:25.726174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9bef4d72-0e23-4adb-8b6a-fd23cea95c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:25.959126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef4d72-0e23-4adb-8b6a-fd23cea95c65 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:26.063892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:26.109475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:26.110345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:26.110633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:26.110902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:26.112679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:26.221148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:26.224318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f2a9-3ce7-4849-af18-699ade47b2c2 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:26.249240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 721/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:27.213093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7737-9c49-4d69-8439-5bd8299da400 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:27.213715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7737-9c49-4d69-8439-5bd8299da400 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:27.213715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7737-9c49-4d69-8439-5bd8299da400 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:27.215058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:31:27.220723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afc8f5-a3e9-4126-96ac-eec75178a911 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:27.221320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afc8f5-a3e9-4126-96ac-eec75178a911 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:27.221471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afc8f5-a3e9-4126-96ac-eec75178a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:27.307791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c6afc8f5-a3e9-4126-96ac-eec75178a911 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:27.309020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c6afc8f5-a3e9-4126-96ac-eec75178a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:27.343211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:27.435406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:27.585043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7737-9c49-4d69-8439-5bd8299da400 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:27.587367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c10a7737-9c49-4d69-8439-5bd8299da400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:27.784557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7737-9c49-4d69-8439-5bd8299da400 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:27.859461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:27.963538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:27.964211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:27.964464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:27.964759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:27.966505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:28.077418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:28.079462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470cda-51b2-43c5-a55f-d2b52f0eddd6 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:28.100270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 697/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:29.065883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d249-c142-4aa0-974d-6f287ad410f0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:29.066503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d249-c142-4aa0-974d-6f287ad410f0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:29.066503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d249-c142-4aa0-974d-6f287ad410f0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:29.068033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:29.074921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75930-fd1c-4035-b16a-61cf9fdaf7c1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:29.075545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75930-fd1c-4035-b16a-61cf9fdaf7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:29.075882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75930-fd1c-4035-b16a-61cf9fdaf7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:29.156139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:29.183709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-78b75930-fd1c-4035-b16a-61cf9fdaf7c1 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:29.185162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-78b75930-fd1c-4035-b16a-61cf9fdaf7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:29.304217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:29.547458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d249-c142-4aa0-974d-6f287ad410f0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:29.549673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4938d249-c142-4aa0-974d-6f287ad410f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:29.753968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d249-c142-4aa0-974d-6f287ad410f0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:29.767793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:29.933077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:29.933749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:29.934005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:29.934302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:29.936160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:30.077061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:30.080226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72015ada-ea9b-4689-8a9e-8b185580654b service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:30.116866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 724/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:31.050156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f5a7-dd64-4106-aaac-9cb902b22ffc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.050766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f5a7-dd64-4106-aaac-9cb902b22ffc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.051164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f5a7-dd64-4106-aaac-9cb902b22ffc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.053294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:31.059077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe78e9-9f27-445c-9d5a-5ae772ee9ed5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.059361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe78e9-9f27-445c-9d5a-5ae772ee9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.059788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe78e9-9f27-445c-9d5a-5ae772ee9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.080754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:31.158594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-defe78e9-9f27-445c-9d5a-5ae772ee9ed5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:31.160644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-defe78e9-9f27-445c-9d5a-5ae772ee9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:31.301519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:31.454177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345f5a7-dd64-4106-aaac-9cb902b22ffc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:31.455940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3345f5a7-dd64-4106-aaac-9cb902b22ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:31.594358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:31.643341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345f5a7-dd64-4106-aaac-9cb902b22ffc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:31.782715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:31.783439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.783758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.784032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.786907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:31.887555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:31.908472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:31.910097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03480978-f324-41fb-9e88-c7eafb50bd20 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:31.930327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 700/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:32.841585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583ae0c-4170-4313-9c1f-e5c77183d109 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:32.842321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583ae0c-4170-4313-9c1f-e5c77183d109 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:32.842321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583ae0c-4170-4313-9c1f-e5c77183d109 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:32.844744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:31:32.852253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35fb4d-7314-4b13-adc2-ac62282e469f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:32.853009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35fb4d-7314-4b13-adc2-ac62282e469f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:32.853009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35fb4d-7314-4b13-adc2-ac62282e469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:32.951751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3f35fb4d-7314-4b13-adc2-ac62282e469f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:32.953703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3f35fb4d-7314-4b13-adc2-ac62282e469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:33.096302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:33.254314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583ae0c-4170-4313-9c1f-e5c77183d109 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:33.255909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4583ae0c-4170-4313-9c1f-e5c77183d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:33.365733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:33.457747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583ae0c-4170-4313-9c1f-e5c77183d109 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:33.587870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:33.588812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:33.589158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:33.589609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:33.591779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:33.656397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:33.702878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:33.704577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4260fc-d79c-4412-8b25-72152f4c8516 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:33.724294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 727/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:34.560796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43cf05-d3bc-4152-ac95-2bfb28b15f6a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.561525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43cf05-d3bc-4152-ac95-2bfb28b15f6a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.561525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43cf05-d3bc-4152-ac95-2bfb28b15f6a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.562686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:31:34.568107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b15a6-818d-4dc2-8e44-72d161d5cf99 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.568646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b15a6-818d-4dc2-8e44-72d161d5cf99 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.568646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b15a6-818d-4dc2-8e44-72d161d5cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.652307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a29b15a6-818d-4dc2-8e44-72d161d5cf99 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:34.653529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a29b15a6-818d-4dc2-8e44-72d161d5cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:34.775175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:34.927692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43cf05-d3bc-4152-ac95-2bfb28b15f6a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.929851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1d43cf05-d3bc-4152-ac95-2bfb28b15f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:34.987791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:35.103990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43cf05-d3bc-4152-ac95-2bfb28b15f6a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:35.267838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:35.268733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:35.269171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:35.269454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:35.271353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:35.281348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:35.415454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:35.418698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d0657-4f52-4be9-b985-6d91ff1a2632 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:35.450711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 703/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:36.309302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b922b-f38e-49f1-a231-bd251f4dbe0d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:36.309865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b922b-f38e-49f1-a231-bd251f4dbe0d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:36.309865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b922b-f38e-49f1-a231-bd251f4dbe0d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:36.311302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:36.317007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4bbd1-cc8d-46ab-b9d0-bbb975cac6cb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:36.317791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4bbd1-cc8d-46ab-b9d0-bbb975cac6cb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:36.317947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4bbd1-cc8d-46ab-b9d0-bbb975cac6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:36.414012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-69e4bbd1-cc8d-46ab-b9d0-bbb975cac6cb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:36.415301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-69e4bbd1-cc8d-46ab-b9d0-bbb975cac6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:36.503880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:36.550127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:36.706828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b922b-f38e-49f1-a231-bd251f4dbe0d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:36.708426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fc2b922b-f38e-49f1-a231-bd251f4dbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:36.727423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:36.890248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b922b-f38e-49f1-a231-bd251f4dbe0d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:36.992254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:37.023675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:37.024350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:37.024626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:37.024893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:37.026706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:37.137827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:37.139557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b51c9-ea56-4313-be2f-e1367bd7ec68 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:37.171482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 730/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:38.006544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c741aa-b600-4e58-b045-6fc202301e0c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:38.007235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c741aa-b600-4e58-b045-6fc202301e0c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:38.007448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c741aa-b600-4e58-b045-6fc202301e0c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:38.009894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:38.017459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6ba92-9fd8-45c4-8905-4416ceb46a59 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:38.018000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6ba92-9fd8-45c4-8905-4416ceb46a59 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:38.018000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6ba92-9fd8-45c4-8905-4416ceb46a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:38.109060 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2fe6ba92-9fd8-45c4-8905-4416ceb46a59 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:38.110300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2fe6ba92-9fd8-45c4-8905-4416ceb46a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:38.168378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:38.236470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:38.400497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c741aa-b600-4e58-b045-6fc202301e0c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:38.402179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-09c741aa-b600-4e58-b045-6fc202301e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:38.582914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c741aa-b600-4e58-b045-6fc202301e0c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:38.654800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:38.741628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:38.742313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:38.742594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:38.742881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:38.744662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:38.853414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:38.855207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a1c53-3dba-47a5-b239-27d165a4b6cd service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:38.875865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 706/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:39.731878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558bfad-2860-4b72-beb1-af8d37c78e1f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:39.732449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558bfad-2860-4b72-beb1-af8d37c78e1f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:39.732449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558bfad-2860-4b72-beb1-af8d37c78e1f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:39.733969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:39.742582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea038bc-ae5e-42a7-916a-f24bf6f3f08a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:39.743349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea038bc-ae5e-42a7-916a-f24bf6f3f08a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:39.743527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea038bc-ae5e-42a7-916a-f24bf6f3f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:39.853314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7ea038bc-ae5e-42a7-916a-f24bf6f3f08a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:39.854656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ea038bc-ae5e-42a7-916a-f24bf6f3f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:39.857008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:40.017102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:40.195121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558bfad-2860-4b72-beb1-af8d37c78e1f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:40.196914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1558bfad-2860-4b72-beb1-af8d37c78e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:40.387121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558bfad-2860-4b72-beb1-af8d37c78e1f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:40.423232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:40.549401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:40.550135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:40.550467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:40.550650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:40.552769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:40.680787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:40.682780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71dcb6-cb67-4506-91e1-4287c08ce7e6 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:40.711823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 733/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:42.684840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e7bf4-8c19-4bcc-ac69-6adcbc8866b1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:42.685408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e7bf4-8c19-4bcc-ac69-6adcbc8866b1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:42.685408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e7bf4-8c19-4bcc-ac69-6adcbc8866b1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:42.686653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:42.693906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db491fd4-808d-449a-ab8b-4dd76c088fab None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:42.694471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db491fd4-808d-449a-ab8b-4dd76c088fab None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:42.694741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db491fd4-808d-449a-ab8b-4dd76c088fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:42.745598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:42.777441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-db491fd4-808d-449a-ab8b-4dd76c088fab None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:42.778683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-db491fd4-808d-449a-ab8b-4dd76c088fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:42.883987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:42.932987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e7bf4-8c19-4bcc-ac69-6adcbc8866b1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:42.934635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-872e7bf4-8c19-4bcc-ac69-6adcbc8866b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:43.059223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e7bf4-8c19-4bcc-ac69-6adcbc8866b1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:43.107891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:43.154925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:43.155651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:43.155928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:43.156200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:43.157944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:43.281450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:43.282930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbab23-8521-4b84-8568-9dd0dec994f9 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:43.306612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 709/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:45.510826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc7e7d-ede7-48f3-b562-c60162d8527a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:45.511949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc7e7d-ede7-48f3-b562-c60162d8527a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:45.511949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc7e7d-ede7-48f3-b562-c60162d8527a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:45.514148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:45.523876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e478-68e7-4fb1-8243-c2f4a905bbed None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:45.524557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e478-68e7-4fb1-8243-c2f4a905bbed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:45.524817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e478-68e7-4fb1-8243-c2f4a905bbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:45.592578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7b44e478-68e7-4fb1-8243-c2f4a905bbed None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:45.593794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b44e478-68e7-4fb1-8243-c2f4a905bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:45.606685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:45.702317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:45.745218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc7e7d-ede7-48f3-b562-c60162d8527a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:45.746807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-11bc7e7d-ede7-48f3-b562-c60162d8527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:45.857229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc7e7d-ede7-48f3-b562-c60162d8527a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:45.869564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:45.940378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:45.941342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:45.941710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:45.942097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:45.944770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:46.075781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:46.077216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa3325-3318-4dd5-9c94-76a67af004bd service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:46.095768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 736/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:48.543716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac249f-9eb4-4091-9548-83f6c2087bf7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:48.544282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac249f-9eb4-4091-9548-83f6c2087bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:48.544282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac249f-9eb4-4091-9548-83f6c2087bf7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:48.545605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:48.552135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591228ad-24eb-4d47-a1ba-ec039e774252 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:48.552810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591228ad-24eb-4d47-a1ba-ec039e774252 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:48.553017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591228ad-24eb-4d47-a1ba-ec039e774252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:48.607534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:48.626309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-591228ad-24eb-4d47-a1ba-ec039e774252 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:48.627602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-591228ad-24eb-4d47-a1ba-ec039e774252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:48.751775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:48.795068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac249f-9eb4-4091-9548-83f6c2087bf7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:48.797352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a4ac249f-9eb4-4091-9548-83f6c2087bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:48.915169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac249f-9eb4-4091-9548-83f6c2087bf7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:48.958454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:49.000528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.001158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.001431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.001721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.003389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:49.137180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.138585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b723b4-e7e9-4836-816c-8e879092d6bf service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.158759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 712/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:51.292401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98758e-4bd5-42b0-8748-ffe3c132f2a0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:51.292976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98758e-4bd5-42b0-8748-ffe3c132f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:51.292976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98758e-4bd5-42b0-8748-ffe3c132f2a0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:51.294405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:51.301458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b07b-721d-4ff9-b112-8c019642ac7e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:51.302198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b07b-721d-4ff9-b112-8c019642ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:51.302346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b07b-721d-4ff9-b112-8c019642ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:51.384062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fd27b07b-721d-4ff9-b112-8c019642ac7e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:51.386051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fd27b07b-721d-4ff9-b112-8c019642ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:51.409283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:51.497653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:51.540675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98758e-4bd5-42b0-8748-ffe3c132f2a0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:51.543131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5e98758e-4bd5-42b0-8748-ffe3c132f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:51.669333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98758e-4bd5-42b0-8748-ffe3c132f2a0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:51.689601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:51.750626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:51.751315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:51.751594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:51.751858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:51.753516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:51.875826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:51.877192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2208-a8c4-496c-ba6a-539922d0cc1b service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:51.896056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 739/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:53.982248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602591-291a-4c4f-9c08-22252fc3f2c6 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:53.983180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602591-291a-4c4f-9c08-22252fc3f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:53.983180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602591-291a-4c4f-9c08-22252fc3f2c6 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:53.985465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:53.992856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a1ce-8edc-468b-a3c5-ae59597fea4e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:53.993555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a1ce-8edc-468b-a3c5-ae59597fea4e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:53.993678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a1ce-8edc-468b-a3c5-ae59597fea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:54.058779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:54.061542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5192a1ce-8edc-468b-a3c5-ae59597fea4e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:54.062870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5192a1ce-8edc-468b-a3c5-ae59597fea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:54.161156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:54.201021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602591-291a-4c4f-9c08-22252fc3f2c6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:54.202561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-86602591-291a-4c4f-9c08-22252fc3f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:54.310573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602591-291a-4c4f-9c08-22252fc3f2c6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:54.361048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:54.390621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:54.391319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:54.391603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:54.391880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:54.393540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:54.514716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:54.516148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4f77-6a9d-4ecc-8a11-aef9598cbf70 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:54.538456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 715/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:56.654718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0074da-8324-4093-b3a6-e5ec250178c6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:56.655575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0074da-8324-4093-b3a6-e5ec250178c6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:56.655738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0074da-8324-4093-b3a6-e5ec250178c6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:56.658024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:56.663877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee235-8e8e-4c74-923a-c106bb456335 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:56.664330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee235-8e8e-4c74-923a-c106bb456335 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:56.664436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee235-8e8e-4c74-923a-c106bb456335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:56.733719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1ceee235-8e8e-4c74-923a-c106bb456335 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:56.734948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ceee235-8e8e-4c74-923a-c106bb456335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:56.764709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:56.844983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:56.889547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0074da-8324-4093-b3a6-e5ec250178c6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:56.892710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2e0074da-8324-4093-b3a6-e5ec250178c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:57.024552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0074da-8324-4093-b3a6-e5ec250178c6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:57.064671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:57.115740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:57.116408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:57.116680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:57.116958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:57.118629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:57.269684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:57.271178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b870a4-671a-46f2-a2f5-799a52f0b076 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:57.291140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 742/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:59.360573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfb34-b2cf-4b3c-b67c-c835e8902222 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:59.361161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfb34-b2cf-4b3c-b67c-c835e8902222 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:59.361161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfb34-b2cf-4b3c-b67c-c835e8902222 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:59.362527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:31:59.368236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37a10-7fa8-473d-9064-cfc86e8569b4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:59.368710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37a10-7fa8-473d-9064-cfc86e8569b4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:59.368802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37a10-7fa8-473d-9064-cfc86e8569b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:59.436916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1af37a10-7fa8-473d-9064-cfc86e8569b4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:59.438132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1af37a10-7fa8-473d-9064-cfc86e8569b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:59.450099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:59.540933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:59.579523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbfb34-b2cf-4b3c-b67c-c835e8902222 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:59.581648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5dfbfb34-b2cf-4b3c-b67c-c835e8902222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:59.695417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbfb34-b2cf-4b3c-b67c-c835e8902222 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:59.750883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:59.771203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:59.771862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:59.772138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:59.772434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:59.774444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:59.892107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:59.893546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d478d-bf95-4eda-b523-97d33c8a264c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:59.913356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 718/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:02.008222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81afce0-7778-49ba-b78d-0c0ba64ee68e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.008672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81afce0-7778-49ba-b78d-0c0ba64ee68e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.008881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81afce0-7778-49ba-b78d-0c0ba64ee68e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.010958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:32:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:02.017096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bc2c8-d3ac-4f13-bfcd-47176c11b476 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.017549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bc2c8-d3ac-4f13-bfcd-47176c11b476 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.017655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bc2c8-d3ac-4f13-bfcd-47176c11b476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.084133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7c7bc2c8-d3ac-4f13-bfcd-47176c11b476 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:02.085316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c7bc2c8-d3ac-4f13-bfcd-47176c11b476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.126674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:02.188734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:02.232746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81afce0-7778-49ba-b78d-0c0ba64ee68e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:02.234908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c81afce0-7778-49ba-b78d-0c0ba64ee68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.342418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81afce0-7778-49ba-b78d-0c0ba64ee68e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:02.382727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:02.424412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899611-be97-417d-b622-089996c4c076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:02.425067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899611-be97-417d-b622-089996c4c076 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.425342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899611-be97-417d-b622-089996c4c076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.425611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899611-be97-417d-b622-089996c4c076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.427284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-82899611-be97-417d-b622-089996c4c076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.544024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82899611-be97-417d-b622-089996c4c076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:02.545485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82899611-be97-417d-b622-089996c4c076 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:02.564652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 745/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:04.591241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e087fd-2799-4812-8840-caea7afddb8d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:04.591813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e087fd-2799-4812-8840-caea7afddb8d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:04.591813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e087fd-2799-4812-8840-caea7afddb8d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:04.593172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:04.598738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906ac8-a213-4bbe-8603-ab5515e8fb51 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:04.599352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906ac8-a213-4bbe-8603-ab5515e8fb51 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:04.599352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906ac8-a213-4bbe-8603-ab5515e8fb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:04.668176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d0906ac8-a213-4bbe-8603-ab5515e8fb51 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:04.669421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d0906ac8-a213-4bbe-8603-ab5515e8fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:04.692335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:04.779044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:04.815990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e087fd-2799-4812-8840-caea7afddb8d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:04.817575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-01e087fd-2799-4812-8840-caea7afddb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:04.930752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e087fd-2799-4812-8840-caea7afddb8d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:05.003981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:05.011670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:05.012332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:05.012603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:05.012852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:05.014550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:05.143137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:05.144603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf9850-5c50-4204-97a9-80b2fbc9fd7a service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:05.164977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 721/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:07.212353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c9930-138f-4fee-9d77-dbaf3f29adb3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:07.212932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c9930-138f-4fee-9d77-dbaf3f29adb3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:07.212932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c9930-138f-4fee-9d77-dbaf3f29adb3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:07.214912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:32:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:07.222981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab262c-4671-4475-ade6-4fbeace98dfa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:07.223508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab262c-4671-4475-ade6-4fbeace98dfa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:07.223611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab262c-4671-4475-ade6-4fbeace98dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:07.293584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-00ab262c-4671-4475-ade6-4fbeace98dfa None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:07.295527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-00ab262c-4671-4475-ade6-4fbeace98dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:07.350204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:07.404708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:32:07.446712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c9930-138f-4fee-9d77-dbaf3f29adb3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:07.449077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-563c9930-138f-4fee-9d77-dbaf3f29adb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:07.571199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c9930-138f-4fee-9d77-dbaf3f29adb3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:07.620536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:07.653674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:07.654506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:07.654874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:07.655270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:07.657601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:07.786748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:07.788227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc8588-d8b3-48d1-b25d-ffa8e1bd3790 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:07.808166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 748/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:17.402653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=22 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:17.804945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=66 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:27.621560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674e0d-666f-4472-ac4e-9fa99d15a1c9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:27.622171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674e0d-666f-4472-ac4e-9fa99d15a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:27.622171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674e0d-666f-4472-ac4e-9fa99d15a1c9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:27.623612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 723/1471] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:27.630451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abae1e-35d5-49aa-91a8-115eadb2c7fa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:27.631206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abae1e-35d5-49aa-91a8-115eadb2c7fa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:27.631206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abae1e-35d5-49aa-91a8-115eadb2c7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:27.723758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f6abae1e-35d5-49aa-91a8-115eadb2c7fa None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:27.725800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f6abae1e-35d5-49aa-91a8-115eadb2c7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:27.842270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 749/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:27.931579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abaffb-2925-42cb-becf-9f8040be9505 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:27.931860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abaffb-2925-42cb-becf-9f8040be9505 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:27.932131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abaffb-2925-42cb-becf-9f8040be9505 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:27.933518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 724/1473] 10.222.0.20 () {54 vars in 966 bytes} [Thu Jul 21 22:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:27.938641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4699-acaa-4272-b349-e2f7ea6e82eb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:27.938926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4699-acaa-4272-b349-e2f7ea6e82eb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:27.939231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4699-acaa-4272-b349-e2f7ea6e82eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:28.022007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-62fb4699-acaa-4272-b349-e2f7ea6e82eb None None] MFA Rules not processed for user `5b5e5657f0c243feaae1824559d6f816`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:28.023261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-62fb4699-acaa-4272-b349-e2f7ea6e82eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:28.047912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:28.116063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 750/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Thu Jul 21 22:32:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:32:28.125453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abaffb-2925-42cb-becf-9f8040be9505 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:28.127015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f1abaffb-2925-42cb-becf-9f8040be9505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:28.249208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abaffb-2925-42cb-becf-9f8040be9505 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:28.344301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:28.344963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:28.345244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:28.345514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:28.347201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:28.413462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:28.490515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:28.491994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0157a5-7cf0-4cf7-bc94-03a8f59ee4d6 service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:28.511383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 725/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:30.630242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137d27a-4d21-4771-9454-0789be5b292c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:30.630812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137d27a-4d21-4771-9454-0789be5b292c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:30.630812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137d27a-4d21-4771-9454-0789be5b292c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:30.632125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 751/1476] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:30.637812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e39d-90aa-4d04-9291-81e82dd33560 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:30.638225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e39d-90aa-4d04-9291-81e82dd33560 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:30.638384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e39d-90aa-4d04-9291-81e82dd33560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:30.710170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f4a9e39d-90aa-4d04-9291-81e82dd33560 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:30.712132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f4a9e39d-90aa-4d04-9291-81e82dd33560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:30.824930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 726/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:30.848681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137d27a-4d21-4771-9454-0789be5b292c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:30.850230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b137d27a-4d21-4771-9454-0789be5b292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:30.987605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137d27a-4d21-4771-9454-0789be5b292c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:31.048393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:31.093954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:31.094714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:31.095036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:31.095297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:31.096041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:31.097874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:32:31.097874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:32:31.097874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:32:31.099030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc141-a7cb-4170-9008-ca0537978c45 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:31.118154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 752/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 22:32:30 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:33.196124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6fb4-6fc5-4f04-a933-809d5d855eff None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:33.196739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6fb4-6fc5-4f04-a933-809d5d855eff None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:33.196739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d6fb4-6fc5-4f04-a933-809d5d855eff None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:33.198072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 727/1479] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:33.204948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251a41-3d7b-4189-968d-3f37b6a5053d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:33.205419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251a41-3d7b-4189-968d-3f37b6a5053d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:33.205521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251a41-3d7b-4189-968d-3f37b6a5053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:33.284398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e0251a41-3d7b-4189-968d-3f37b6a5053d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:33.285645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e0251a41-3d7b-4189-968d-3f37b6a5053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:33.393172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 753/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:33.442946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6fb4-6fc5-4f04-a933-809d5d855eff None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:33.444902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-160d6fb4-6fc5-4f04-a933-809d5d855eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:33.459694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:33.612119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d6fb4-6fc5-4f04-a933-809d5d855eff None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:33.696891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:33.732982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:33.733568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:33.733845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:33.734113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:33.735869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:33.829047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:33.830770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec365e2-4bc0-4f93-b9ed-94c52b102063 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:33.848922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 728/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:36.091056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c15e-bb85-4e0f-a4a7-57966af46929 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:36.091656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c15e-bb85-4e0f-a4a7-57966af46929 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:36.091656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2c15e-bb85-4e0f-a4a7-57966af46929 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:36.093044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 754/1482] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:36.099545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc56c2-922c-4a12-a1d2-9957385a7c12 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:36.099994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc56c2-922c-4a12-a1d2-9957385a7c12 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:36.100104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc56c2-922c-4a12-a1d2-9957385a7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:36.174215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cedc56c2-922c-4a12-a1d2-9957385a7c12 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:36.175472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cedc56c2-922c-4a12-a1d2-9957385a7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:36.233316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:36.285785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 729/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:36.326490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2c15e-bb85-4e0f-a4a7-57966af46929 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:36.328139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50f2c15e-bb85-4e0f-a4a7-57966af46929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:36.358246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:36.453885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2c15e-bb85-4e0f-a4a7-57966af46929 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:36.536867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:36.537583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:36.537906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:36.538221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:36.540208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:36.630436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:36.670265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:36.671756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a03057-2c4b-48b1-ad44-a485db7c7a21 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:36.693986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 755/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:38.840827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b84673-9f82-43f2-aeb0-5bc31831c6b8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.841398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b84673-9f82-43f2-aeb0-5bc31831c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.841398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b84673-9f82-43f2-aeb0-5bc31831c6b8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.842720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 730/1485] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:38.849379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84128-8fd0-4b15-9d3b-7fb3197357ad None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.850107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84128-8fd0-4b15-9d3b-7fb3197357ad None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.850294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84128-8fd0-4b15-9d3b-7fb3197357ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.926695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7cf84128-8fd0-4b15-9d3b-7fb3197357ad None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:38.928105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7cf84128-8fd0-4b15-9d3b-7fb3197357ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.036013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 756/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:39.075565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b84673-9f82-43f2-aeb0-5bc31831c6b8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.077130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c5b84673-9f82-43f2-aeb0-5bc31831c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.193405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b84673-9f82-43f2-aeb0-5bc31831c6b8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.274908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:39.277348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.278030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.278339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.278615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.281139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.396420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.397882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb549579-01b9-4be1-bf40-a75a01d110f0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.418848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 731/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:41.523424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5166-396e-4d55-a9da-12b10db229a2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:41.524019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5166-396e-4d55-a9da-12b10db229a2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:41.524019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b5166-396e-4d55-a9da-12b10db229a2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:41.525745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 757/1488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:41.534504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068a7e-918d-4c4f-b8e7-dc0750e5c305 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:41.534925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068a7e-918d-4c4f-b8e7-dc0750e5c305 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:41.535108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068a7e-918d-4c4f-b8e7-dc0750e5c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:41.608827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b8068a7e-918d-4c4f-b8e7-dc0750e5c305 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:41.610032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b8068a7e-918d-4c4f-b8e7-dc0750e5c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:41.664312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:41.711140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 732/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:41.754800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b5166-396e-4d55-a9da-12b10db229a2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:41.756402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-015b5166-396e-4d55-a9da-12b10db229a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:41.793596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:41.869385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b5166-396e-4d55-a9da-12b10db229a2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:41.961531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:41.962188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:41.962464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:41.962735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:41.964414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:42.049226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:42.079884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:42.081307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76fe46-35c0-4817-bf13-4bf0c301c788 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:42.108025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 758/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:44.330512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b5cc-1178-430d-9e76-838d2d07f482 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:44.331161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b5cc-1178-430d-9e76-838d2d07f482 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:44.331161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606b5cc-1178-430d-9e76-838d2d07f482 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:44.332456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 733/1491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 22:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:44.338881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8983-8cc4-4823-82b7-9ff38001f498 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:44.339628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8983-8cc4-4823-82b7-9ff38001f498 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:44.339851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c8983-8cc4-4823-82b7-9ff38001f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:44.421737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-052c8983-8cc4-4823-82b7-9ff38001f498 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:44.423181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-052c8983-8cc4-4823-82b7-9ff38001f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:44.539280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 759/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:44.581334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b5cc-1178-430d-9e76-838d2d07f482 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:44.583336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2606b5cc-1178-430d-9e76-838d2d07f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:44.693336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606b5cc-1178-430d-9e76-838d2d07f482 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:44.777133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:44.777791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:44.778068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:44.778337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:44.780068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:44.790587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:44.909934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:44.911443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614a69-dabf-4028-97c2-c14522162475 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:44.930292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 734/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:54.537261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=82 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:54.927298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=50 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:11.501047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:11.501643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:11.501643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:11.589073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:11.590312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:11.701086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 760/1494] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:11.709322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:11.709888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:11.709888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:11.794122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:11.795417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:11.902729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 735/1495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:11.907931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:11.909151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:11.921426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838385-756e-490c-afcd-5170d60bd875 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:11.985921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:12.023672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:12.024391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:12.024693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:12.024945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:12.025679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:34:12.025982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:12.027015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:12.027015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:34:12.027015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:34:12.027962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:12.040755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 761/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:34:12.049434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:12.059802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796d786-1922-4233-b5cd-8b78d2f78bee None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:12.134299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:12.172802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:12.173600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:12.173888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:12.174167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:12.174876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:12.176722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:12.176722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:34:12.176722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:34:12.177945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:12.245658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 736/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:34:12 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:34:12.249906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:12.251573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:12.291153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f164-d7ff-42c0-8bca-440357631a7c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:12.397960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:12.398713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:12.399177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:12.399339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:12.399970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:12.400990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:12.400990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:34:12.400990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:34:12.402209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:12.448722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 762/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:34:12 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:34:12.453129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:12.454724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:12.532919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0ee93-d085-4c2e-ae24-7b67aa65c6a4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:12.628716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:12.639978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:12.640775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:12.641078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:12.641354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:12.642091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:12.645512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:12.645512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:34:12.645512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:34:12.645512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:12.658184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 737/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:34:12.662679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:12.664678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:12.680814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1c58-bef1-4de3-91dd-4f502d6ecced admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:12.708193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:12.787926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:12.788515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:12.788790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:12.789061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:12.789833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:12.790854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:12.790854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:34:12.790854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:34:12.792072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9764ded-5e34-49a8-8028-f55bdd785b65 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:12.807528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 763/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:34:12.812013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:12.813742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:12.864558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb563cf-e5f7-4c37-8aba-31b3d58095d1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:12.972887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:12.973791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:12.974071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:12.974343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] PATH_INFO: `/v3/projects/cdb89973d6f14102be1f1b79c096d06a/users/89b70e0555174053b4985dc723e84cf5/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:12.998347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb89973d6f14102be1f1b79c096d06a, user_id=89b70e0555174053b4985dc723e84cf5, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:12.999455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:12.999455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:34:12.999455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:34:13.001375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317c66-acfe-4d96-a65a-03767abcceac admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:13.030409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 738/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:34:12 2022] PUT /identity/v3/projects/cdb89973d6f14102be1f1b79c096d06a/users/89b70e0555174053b4985dc723e84cf5/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:13.043555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fffb2-960e-4d98-b80d-6644fbe48ffc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:13.043779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fffb2-960e-4d98-b80d-6644fbe48ffc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:13.044010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fffb2-960e-4d98-b80d-6644fbe48ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:13.105775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d45fffb2-960e-4d98-b80d-6644fbe48ffc None None] MFA Rules not processed for user `89b70e0555174053b4985dc723e84cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:13.107036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d45fffb2-960e-4d98-b80d-6644fbe48ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:13.208829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 764/1502] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:34:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:13.224875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8f48d-4be8-4ecd-a9fc-6ee34dbd2f0f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:13.225154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8f48d-4be8-4ecd-a9fc-6ee34dbd2f0f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:13.225469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8f48d-4be8-4ecd-a9fc-6ee34dbd2f0f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:13.226940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 739/1503] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jul 21 22:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:34:13.232214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d3c7a-19c4-4940-8f84-1215caa0e55a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:13.232501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d3c7a-19c4-4940-8f84-1215caa0e55a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:13.232771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d3c7a-19c4-4940-8f84-1215caa0e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:13.264332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:13.315141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3a6d3c7a-19c4-4940-8f84-1215caa0e55a None None] MFA Rules not processed for user `a0861b19130e41e39a57a61c8972336f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:13.316362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3a6d3c7a-19c4-4940-8f84-1215caa0e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:13.411806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 765/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jul 21 22:34:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:13.420500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8f48d-4be8-4ecd-a9fc-6ee34dbd2f0f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:13.422064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ad8f48d-4be8-4ecd-a9fc-6ee34dbd2f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:13.476308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:13.540221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8f48d-4be8-4ecd-a9fc-6ee34dbd2f0f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:13.622451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:13.623020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:13.623325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:13.623601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:13.625276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:13.730550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:13.732062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:13.735715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:13.752061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 740/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:13.802324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77ee9-a916-43aa-8e06-ad540059d4dc None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:13.802873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77ee9-a916-43aa-8e06-ad540059d4dc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:13.802873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77ee9-a916-43aa-8e06-ad540059d4dc None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:13.804236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 766/1506] 10.222.0.20 () {52 vars in 829 bytes} [Thu Jul 21 22:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:34:13.808479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:13.809770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:13.924221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be463f-b29a-4ec9-894c-89682f2b4f06 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:14.033944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:14.034852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:14.035178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:14.035548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] PATH_INFO: `/v3/users/89b70e0555174053b4985dc723e84cf5` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:14.050355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b70e0555174053b4985dc723e84cf5)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:14.051460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:14.051460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:34:14.051460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:34:14.052714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:14.064667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:14.134510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b70e0555174053b4985dc723e84cf5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:14.144890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b70e0555174053b4985dc723e84cf5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:14.145381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b70e0555174053b4985dc723e84cf5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:14.159534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b70e0555174053b4985dc723e84cf5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:14.181681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b70e0555174053b4985dc723e84cf5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:14.189156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 741/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:34:13 2022] DELETE /identity/v3/users/89b70e0555174053b4985dc723e84cf5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:14.194033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:14.194315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:14.194614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:14.260575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:14.261841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:14.354112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:14.368110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 767/1508] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:14.378364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:14.379646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:14.491654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfcc26-6ad7-4c98-85dc-cada2ea23194 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:14.562257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:14.583806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:14.584479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:14.584755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:14.585025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:14.586749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:14.718646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:14.720167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2361e-d12b-4e99-ad1d-05693562e01c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:14.745655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 742/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:15.114541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:15.116004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:15.132512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25ecc2-919e-48e5-bfbe-3b6b0242a267 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:15.279467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:15.280272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:15.280551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:15.280801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] PATH_INFO: `/v3/projects/cdb89973d6f14102be1f1b79c096d06a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:15.296443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb89973d6f14102be1f1b79c096d06a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:15.297503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:34:15.297503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:34:15.297503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:34:15.298738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:15.365666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb89973d6f14102be1f1b79c096d06a', 'request_id': 'req-f35e7b38-24c1-400b-901b-6c604e674e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:15.388154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb89973d6f14102be1f1b79c096d06a', 'request_id': 'req-f35e7b38-24c1-400b-901b-6c604e674e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:15.393440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb89973d6f14102be1f1b79c096d06a', 'request_id': 'req-f35e7b38-24c1-400b-901b-6c604e674e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:15.426774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] The token cache is being invalidate because project cdb89973d6f14102be1f1b79c096d06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:34:15.427085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:15.427504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f35e7b38-24c1-400b-901b-6c604e674e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:15.429030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 768/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:34:15 2022] DELETE /identity/v3/projects/cdb89973d6f14102be1f1b79c096d06a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:24.742814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=62 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:25.424439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:01.222156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85866-4ef1-4b96-9d5e-701dbe5d5a66 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:01.223208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85866-4ef1-4b96-9d5e-701dbe5d5a66 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:01.223208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85866-4ef1-4b96-9d5e-701dbe5d5a66 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:01.224267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:01.229818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e23e-e708-4e8b-b1e5-1dc71a7d1d03 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:01.230374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e23e-e708-4e8b-b1e5-1dc71a7d1d03 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:01.230374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e23e-e708-4e8b-b1e5-1dc71a7d1d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:01.326386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0b50e23e-e708-4e8b-b1e5-1dc71a7d1d03 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:01.327657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0b50e23e-e708-4e8b-b1e5-1dc71a7d1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:01.462385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:01.616456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85866-4ef1-4b96-9d5e-701dbe5d5a66 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:01.619557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2ce85866-4ef1-4b96-9d5e-701dbe5d5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:01.769271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85866-4ef1-4b96-9d5e-701dbe5d5a66 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:01.775245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60137e-94ae-4c43-9453-bd98228d4a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:01.775911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60137e-94ae-4c43-9453-bd98228d4a1e service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:01.776189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60137e-94ae-4c43-9453-bd98228d4a1e service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:01.776460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60137e-94ae-4c43-9453-bd98228d4a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:01.785824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60137e-94ae-4c43-9453-bd98228d4a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:01.787494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60137e-94ae-4c43-9453-bd98228d4a1e service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:01.798755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 744/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:02.669291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa965d5-083f-4b8a-9723-d4704eeb3fc2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.669929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa965d5-083f-4b8a-9723-d4704eeb3fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.669929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa965d5-083f-4b8a-9723-d4704eeb3fc2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.671283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:36:02.678082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50606a39-9ecb-4a50-962f-e21402069c6e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.678912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50606a39-9ecb-4a50-962f-e21402069c6e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.679329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50606a39-9ecb-4a50-962f-e21402069c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.706089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-50606a39-9ecb-4a50-962f-e21402069c6e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:02.707462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-50606a39-9ecb-4a50-962f-e21402069c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.716429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:02.873259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa965d5-083f-4b8a-9723-d4704eeb3fc2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:02.889210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa965d5-083f-4b8a-9723-d4704eeb3fc2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:02.895994 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f4bd-5ed1-4f7b-a3ca-9bb5cfbc38aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:02.896672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f4bd-5ed1-4f7b-a3ca-9bb5cfbc38aa service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.896951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f4bd-5ed1-4f7b-a3ca-9bb5cfbc38aa service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.897217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f4bd-5ed1-4f7b-a3ca-9bb5cfbc38aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.907070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800f4bd-5ed1-4f7b-a3ca-9bb5cfbc38aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:02.908743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800f4bd-5ed1-4f7b-a3ca-9bb5cfbc38aa service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:02.923011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 771/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:03.045406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169338fa-2ec9-47fa-b0e0-1ffa2d84b145 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.045707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169338fa-2ec9-47fa-b0e0-1ffa2d84b145 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.046007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169338fa-2ec9-47fa-b0e0-1ffa2d84b145 None None] PATH_INFO: `/v3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.047444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 746/1517] 10.222.0.45 () {54 vars in 925 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:03.055798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b89b-6319-4e74-9fa0-be7470566923 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.056304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b89b-6319-4e74-9fa0-be7470566923 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.056788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b89b-6319-4e74-9fa0-be7470566923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.144088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2856b89b-6319-4e74-9fa0-be7470566923 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:03.145710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2856b89b-6319-4e74-9fa0-be7470566923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.170641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:03.255253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 772/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:12.290520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c3b2-9ea1-4532-bfcd-c24f92d99250 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.291152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c3b2-9ea1-4532-bfcd-c24f92d99250 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.291152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c3b2-9ea1-4532-bfcd-c24f92d99250 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.292844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 747/1519] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jul 21 22:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:36:12.302530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa97a-3da1-4d44-9b7b-15d2f107d185 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.303203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa97a-3da1-4d44-9b7b-15d2f107d185 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.303602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aa97a-3da1-4d44-9b7b-15d2f107d185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.336985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-482aa97a-3da1-4d44-9b7b-15d2f107d185 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:12.338349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-482aa97a-3da1-4d44-9b7b-15d2f107d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:12.348506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 773/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jul 21 22:36:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:12.357792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c3b2-9ea1-4532-bfcd-c24f92d99250 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.377631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c3b2-9ea1-4532-bfcd-c24f92d99250 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.385545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bcd80-b551-4eb6-a372-39b14f88f574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.386248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcd80-b551-4eb6-a372-39b14f88f574 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.386536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcd80-b551-4eb6-a372-39b14f88f574 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.386812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcd80-b551-4eb6-a372-39b14f88f574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.405123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bcd80-b551-4eb6-a372-39b14f88f574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.407103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bcd80-b551-4eb6-a372-39b14f88f574 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.420621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 748/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:14.244549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eed5fd-d053-4802-878d-302d7fa1ea42 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.245379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eed5fd-d053-4802-878d-302d7fa1ea42 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.245379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eed5fd-d053-4802-878d-302d7fa1ea42 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.247286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:36:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:14.255478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da0cb-a0c9-4791-8432-8bdc75ef0460 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.256236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da0cb-a0c9-4791-8432-8bdc75ef0460 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.256397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da0cb-a0c9-4791-8432-8bdc75ef0460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.280745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-126da0cb-a0c9-4791-8432-8bdc75ef0460 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:14.282028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-126da0cb-a0c9-4791-8432-8bdc75ef0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:14.290491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:14.449024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eed5fd-d053-4802-878d-302d7fa1ea42 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.464580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eed5fd-d053-4802-878d-302d7fa1ea42 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.471426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d141a-f077-4de8-8497-cc293b82af7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.472222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d141a-f077-4de8-8497-cc293b82af7f service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.472615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d141a-f077-4de8-8497-cc293b82af7f service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.472941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d141a-f077-4de8-8497-cc293b82af7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.485693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d141a-f077-4de8-8497-cc293b82af7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.487986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d141a-f077-4de8-8497-cc293b82af7f service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.505919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 775/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:15.360358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737a45-d64c-4d50-b589-4e3eef0dec1c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.361008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737a45-d64c-4d50-b589-4e3eef0dec1c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.361008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737a45-d64c-4d50-b589-4e3eef0dec1c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.362332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:15.368077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded997-8bd5-4b99-b205-d546c9918025 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.368617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded997-8bd5-4b99-b205-d546c9918025 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.368939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded997-8bd5-4b99-b205-d546c9918025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.530881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-53ded997-8bd5-4b99-b205-d546c9918025 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:15.532167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-53ded997-8bd5-4b99-b205-d546c9918025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:15.540586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:15.700732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737a45-d64c-4d50-b589-4e3eef0dec1c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:15.716870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737a45-d64c-4d50-b589-4e3eef0dec1c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:15.722687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dce2b0-12f9-4664-90d9-17e1db01e964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:15.723389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dce2b0-12f9-4664-90d9-17e1db01e964 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.723670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dce2b0-12f9-4664-90d9-17e1db01e964 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.723950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dce2b0-12f9-4664-90d9-17e1db01e964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.734929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dce2b0-12f9-4664-90d9-17e1db01e964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:15.737873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dce2b0-12f9-4664-90d9-17e1db01e964 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:15.750559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 751/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:19.829161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b6ac-550c-4d0a-87fb-d7f7a9c5c41d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:19.829789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b6ac-550c-4d0a-87fb-d7f7a9c5c41d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:19.829789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b6ac-550c-4d0a-87fb-d7f7a9c5c41d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:19.831180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:19.837027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042644-c93c-4043-a969-0cf60629be01 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:19.837733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042644-c93c-4043-a969-0cf60629be01 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:19.837733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042644-c93c-4043-a969-0cf60629be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:19.857378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-40042644-c93c-4043-a969-0cf60629be01 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:19.858759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-40042644-c93c-4043-a969-0cf60629be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:19.867875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:19.954224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1b6ac-550c-4d0a-87fb-d7f7a9c5c41d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:19.956922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5ee1b6ac-550c-4d0a-87fb-d7f7a9c5c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:20.061899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1b6ac-550c-4d0a-87fb-d7f7a9c5c41d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:20.065650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c2204-39c3-4088-8a7a-a679e7ecdd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:20.066312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2204-39c3-4088-8a7a-a679e7ecdd45 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:20.066590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2204-39c3-4088-8a7a-a679e7ecdd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:20.066860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2204-39c3-4088-8a7a-a679e7ecdd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:20.076919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2204-39c3-4088-8a7a-a679e7ecdd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:20.078357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2204-39c3-4088-8a7a-a679e7ecdd45 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:20.089211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 778/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:22.158227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d696d6-49d3-4a63-bb07-f658b4a6e119 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.158843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d696d6-49d3-4a63-bb07-f658b4a6e119 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.158843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d696d6-49d3-4a63-bb07-f658b4a6e119 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.160280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:22.166701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b7ed-8f31-478d-bfc2-cb4c5e788f04 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.167433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b7ed-8f31-478d-bfc2-cb4c5e788f04 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.167603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b7ed-8f31-478d-bfc2-cb4c5e788f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.191129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4075b7ed-8f31-478d-bfc2-cb4c5e788f04 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:22.192405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4075b7ed-8f31-478d-bfc2-cb4c5e788f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.201538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:22.250872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d696d6-49d3-4a63-bb07-f658b4a6e119 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.264424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d696d6-49d3-4a63-bb07-f658b4a6e119 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.269385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7d7e-7011-4f34-bc18-d5c665cb958b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.270060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7d7e-7011-4f34-bc18-d5c665cb958b service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.270346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7d7e-7011-4f34-bc18-d5c665cb958b service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.270623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7d7e-7011-4f34-bc18-d5c665cb958b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.282150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7d7e-7011-4f34-bc18-d5c665cb958b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.284626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7d7e-7011-4f34-bc18-d5c665cb958b service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:22.296850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 754/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:26.040980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43896-fa6d-4734-9106-c270b7928e0b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.041697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43896-fa6d-4734-9106-c270b7928e0b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.041697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e43896-fa6d-4734-9106-c270b7928e0b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.042931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:26.048937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8be59-8958-4058-8e16-eb8d4e873f51 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.049536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8be59-8958-4058-8e16-eb8d4e873f51 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.049536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8be59-8958-4058-8e16-eb8d4e873f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.055968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=81 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:26.069196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c8c8be59-8958-4058-8e16-eb8d4e873f51 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:26.070481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c8c8be59-8958-4058-8e16-eb8d4e873f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.078842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:26.391365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43896-fa6d-4734-9106-c270b7928e0b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.393713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-99e43896-fa6d-4734-9106-c270b7928e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.480394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:26.500228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e43896-fa6d-4734-9106-c270b7928e0b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.504804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef091c9-3932-4be9-a384-5914f361f7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.505494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef091c9-3932-4be9-a384-5914f361f7ac service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.505773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef091c9-3932-4be9-a384-5914f361f7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.506065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef091c9-3932-4be9-a384-5914f361f7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.519432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef091c9-3932-4be9-a384-5914f361f7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.521999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef091c9-3932-4be9-a384-5914f361f7ac service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.543193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 781/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:28.639763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c872ba-f01d-4eb0-9183-6dba969fd2a1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:28.640575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c872ba-f01d-4eb0-9183-6dba969fd2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:28.640575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c872ba-f01d-4eb0-9183-6dba969fd2a1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:28.641608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:36:28.647823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e00a-f163-4c2d-90b3-cfc854d88b8b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:28.648611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e00a-f163-4c2d-90b3-cfc854d88b8b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:28.648611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e00a-f163-4c2d-90b3-cfc854d88b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:28.666948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-da69e00a-f163-4c2d-90b3-cfc854d88b8b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:28.668228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-da69e00a-f163-4c2d-90b3-cfc854d88b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:28.676429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:28.987239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c872ba-f01d-4eb0-9183-6dba969fd2a1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:28.989226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-62c872ba-f01d-4eb0-9183-6dba969fd2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:29.005169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c872ba-f01d-4eb0-9183-6dba969fd2a1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:29.010097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbaf2f-ca20-4f0a-bcf0-117bfb5dd3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:29.010840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbaf2f-ca20-4f0a-bcf0-117bfb5dd3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:29.011243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbaf2f-ca20-4f0a-bcf0-117bfb5dd3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:29.011524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbaf2f-ca20-4f0a-bcf0-117bfb5dd3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:29.022538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbaf2f-ca20-4f0a-bcf0-117bfb5dd3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:29.024044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbaf2f-ca20-4f0a-bcf0-117bfb5dd3c9 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:29.034979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 757/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:38.662013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=11 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:39.030037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=8 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:12.451763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad84991-407d-4110-b850-e8893237cd82 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.453280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad84991-407d-4110-b850-e8893237cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.453280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad84991-407d-4110-b850-e8893237cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.484708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3ad84991-407d-4110-b850-e8893237cd82 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:12.485987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3ad84991-407d-4110-b850-e8893237cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:12.502332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 783/1540] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:12.513632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.519788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.520786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.530720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6815-27b0-4400-99af-6ee76f2fa5b5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.531043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6815-27b0-4400-99af-6ee76f2fa5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.531363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6815-27b0-4400-99af-6ee76f2fa5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.556335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:12.558597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:12.565312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f5ee6815-27b0-4400-99af-6ee76f2fa5b5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:12.567022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f5ee6815-27b0-4400-99af-6ee76f2fa5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:12.588966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 758/1541] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:38:12.590662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 784/1542] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:38:12.595172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:12.611533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dda02-9b54-4ae2-88d5-cff9af65970c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:12.618593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.618872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.619216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.625797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:12.627026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.627707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.628133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.629095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:12.629633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:12.631567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:38:12.631567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:38:12.631567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:38:12.632959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:12.657425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:12.658579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:12.666163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 759/1543] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:38:12.675810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:12.689129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 785/1544] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:12.693788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c663813-b079-4231-b415-e36a0b82baed admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:12.694069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:12.709406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:12.709406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.709406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.710013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.710194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8cc7-bbe7-4326-8d46-2a83a21a29b8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:12.710350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:12.713336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:12.726980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:12.727847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.728131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.728398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.729141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:12.729444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:12.731862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:12.755933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 786/1545] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:12.765067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:12.781164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28d28-a2ab-4337-ba6f-1b21b1e91674 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:12.795547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:12.796634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.796961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.797230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.797954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:12.799149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:38:12.799149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:38:12.799149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:38:12.800840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:12.817815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 760/1546] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:38:12.823669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:12.852246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 787/1547] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:38:12.857965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:12.960562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715360-3c6f-4a73-9803-0f9dfbcf7b27 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:12.972224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595ebb-f830-4f9b-b355-1604333369cd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:12.976253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f294c-4ff3-4c71-a5b2-21bfeb32e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:12.977062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f294c-4ff3-4c71-a5b2-21bfeb32e48c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.977519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f294c-4ff3-4c71-a5b2-21bfeb32e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.977980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f294c-4ff3-4c71-a5b2-21bfeb32e48c admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:12.979134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f294c-4ff3-4c71-a5b2-21bfeb32e48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:12.982167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f294c-4ff3-4c71-a5b2-21bfeb32e48c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:12.997193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:12.998419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:12.998907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:12.999433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.000740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.002596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:38:13.002596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:38:13.002596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:38:13.007749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50145-a085-4162-8478-99027fdcab87 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.035839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 788/1548] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:38:13.037182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb83e82-8165-4ce2-8a8e-7c81692483fa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.037485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb83e82-8165-4ce2-8a8e-7c81692483fa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.038288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb83e82-8165-4ce2-8a8e-7c81692483fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.056456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 761/1549] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:12 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:13.057462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.057728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.062568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.082306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4bb83e82-8165-4ce2-8a8e-7c81692483fa None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.084345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4bb83e82-8165-4ce2-8a8e-7c81692483fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.105929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.107185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.113630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 789/1550] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.115119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.115447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.115713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.120250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 762/1551] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.122353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.138090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.139704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.140998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cf389-7909-406d-a812-a5e1d98d4f41 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.148567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050f4bc-15f0-4347-8767-1a3eb8423c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.149146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 790/1552] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.154700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f4bc-15f0-4347-8767-1a3eb8423c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.154913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.155087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f4bc-15f0-4347-8767-1a3eb8423c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.155087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050f4bc-15f0-4347-8767-1a3eb8423c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.155087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050f4bc-15f0-4347-8767-1a3eb8423c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.155087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050f4bc-15f0-4347-8767-1a3eb8423c69 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.160363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dcf95-1822-4bf3-813e-348b00f576bf None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.165023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 763/1553] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:13.165292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd813c1-ba8e-4f5c-a219-480538d35a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.165780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd813c1-ba8e-4f5c-a219-480538d35a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.166115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd813c1-ba8e-4f5c-a219-480538d35a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.166395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd813c1-ba8e-4f5c-a219-480538d35a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.167024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac465-6d51-45e1-b7be-3084ffa4f135 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.167201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd813c1-ba8e-4f5c-a219-480538d35a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.167356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac465-6d51-45e1-b7be-3084ffa4f135 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.167661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac465-6d51-45e1-b7be-3084ffa4f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.168663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd813c1-ba8e-4f5c-a219-480538d35a48 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.180166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 791/1554] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:13.181526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafd6e-6f33-4c13-98d4-30a78d205d34 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.181814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafd6e-6f33-4c13-98d4-30a78d205d34 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.182081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafd6e-6f33-4c13-98d4-30a78d205d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.187677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4b8ac465-6d51-45e1-b7be-3084ffa4f135 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.188906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4b8ac465-6d51-45e1-b7be-3084ffa4f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.197716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 764/1555] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.199237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf574a-0aca-41cd-b92a-0e94449d3f60 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.199531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf574a-0aca-41cd-b92a-0e94449d3f60 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.199812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf574a-0aca-41cd-b92a-0e94449d3f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.201141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3bbafd6e-6f33-4c13-98d4-30a78d205d34 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.202700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3bbafd6e-6f33-4c13-98d4-30a78d205d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.215290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 792/1556] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.216472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12521a-1c0d-4a3e-a7b0-0267aa5c3764 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.216768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12521a-1c0d-4a3e-a7b0-0267aa5c3764 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.217036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12521a-1c0d-4a3e-a7b0-0267aa5c3764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.231137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5bbf574a-0aca-41cd-b92a-0e94449d3f60 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.232634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5bbf574a-0aca-41cd-b92a-0e94449d3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.239255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5e12521a-1c0d-4a3e-a7b0-0267aa5c3764 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.240496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5e12521a-1c0d-4a3e-a7b0-0267aa5c3764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.244682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 765/1557] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.244682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.244682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.244682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.259565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 793/1558] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.261352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.261792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.262217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.267238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.268781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.279319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 766/1559] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.280856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.298575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed520c-ebaa-4ebb-95e3-6230ff5140ea None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.303384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.305510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.305696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0744c-1e2e-4a6e-9041-bb822b093672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.306636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0744c-1e2e-4a6e-9041-bb822b093672 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.307143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0744c-1e2e-4a6e-9041-bb822b093672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.307599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0744c-1e2e-4a6e-9041-bb822b093672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.308888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0744c-1e2e-4a6e-9041-bb822b093672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.311897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0744c-1e2e-4a6e-9041-bb822b093672 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.318216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 794/1560] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.320171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.330668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 767/1561] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:13.332367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.332743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.333115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.338682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cc95-e68d-4a7f-936e-3f363e713dda None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.347810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2772e88-8344-4913-8e49-d73e0764329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.349049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2772e88-8344-4913-8e49-d73e0764329d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.350011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2772e88-8344-4913-8e49-d73e0764329d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.352346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2772e88-8344-4913-8e49-d73e0764329d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.352346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2772e88-8344-4913-8e49-d73e0764329d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.354447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2772e88-8344-4913-8e49-d73e0764329d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.368506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 795/1562] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:13.371970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.373732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.374936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bce67-3c83-4164-a610-08d91c841e78 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.375462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bce67-3c83-4164-a610-08d91c841e78 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.375968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bce67-3c83-4164-a610-08d91c841e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.385314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 768/1563] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.386600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.401907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d021-ff95-4d7e-8246-a7854b9e0df8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.404751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-089bce67-3c83-4164-a610-08d91c841e78 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.406094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-089bce67-3c83-4164-a610-08d91c841e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.406981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.407755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.407990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.408431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.409169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:13.409475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.411140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.414351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 796/1564] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.415689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.415973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.416246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.431175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 769/1565] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:13.433155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.434537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.435800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.447689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 797/1566] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.448551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.449392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a576-7dff-4001-819c-7c91946d67fa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.454697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.455406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.455692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.455955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.456690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:13.457009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.458628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.459277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425359d2-1ccb-41b8-91cd-88daccfe7168 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.464427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.465133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.465514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.465715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.466445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:13.466756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.468564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.472570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 770/1567] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:13.473475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.484137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2b5ec-db21-49b5-b68f-4ddd77e402c0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.487156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 798/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:13.487664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.495778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.496914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.497248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.497580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] PATH_INFO: `/v3/projects/1bfc0d0018b0476a99193b24c90f775f/users/c2e2a3ec4d0a43479b487e5faaf9a233/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.504231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e820bb-8d27-48ed-86d9-1017f9e7bc2e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.511594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.512536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.512828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.513130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] PATH_INFO: `/v3/projects/d28a8a10e6664ef3b19077ee599cc3f7/users/18f4b2c24c4f4e84970cd37f66397288/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.514457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfc0d0018b0476a99193b24c90f775f, user_id=c2e2a3ec4d0a43479b487e5faaf9a233, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.517397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.519770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:13.528104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:13.534701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28a8a10e6664ef3b19077ee599cc3f7, user_id=18f4b2c24c4f4e84970cd37f66397288, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.536140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:38:13.536140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:38:13.536140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:38:13.537638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 771/1569] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:13 2022] PUT /identity/v3/projects/1bfc0d0018b0476a99193b24c90f775f/users/c2e2a3ec4d0a43479b487e5faaf9a233/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:13.541760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.541885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.553359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 799/1570] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:13 2022] PUT /identity/v3/projects/d28a8a10e6664ef3b19077ee599cc3f7/users/18f4b2c24c4f4e84970cd37f66397288/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:13.562665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.629106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7dc65-2b26-4b9c-afa1-d77d5eb67d0d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.634228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.634941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.635258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.635536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.636279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:13.636590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.638219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.641460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60d8c-f0c3-47c2-987d-47adb1638987 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.646647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.647691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.648784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.649090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.649846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:13.650200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.651983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.655269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 772/1571] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:13.656422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.667145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5b8a-9ac5-466a-8050-13cd5b1d2709 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.672561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.673240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.673525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.673798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.674500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.674656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 800/1572] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:13.676108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.681301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.691710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57dd8d-711a-435c-8b14-6b92eaa135e0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.699221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.700106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.700620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.701049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.702374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:13.702884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.705340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.715820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 773/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:13.717339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.732728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 801/1574] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:13.732728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.738748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e4f09-f749-44d4-bd47-caddff540691 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.799204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299017fa-510c-4da6-bde8-24406b56a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.799897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299017fa-510c-4da6-bde8-24406b56a67f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.800166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299017fa-510c-4da6-bde8-24406b56a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.800475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299017fa-510c-4da6-bde8-24406b56a67f admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.801154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299017fa-510c-4da6-bde8-24406b56a67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.803126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299017fa-510c-4da6-bde8-24406b56a67f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.805391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37e6b-5c89-40cb-9c30-5b16c6adce07 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.813345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665218-1d4d-49e8-b6c9-7e0ec3a7ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:13.814417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665218-1d4d-49e8-b6c9-7e0ec3a7ab3a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.814902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665218-1d4d-49e8-b6c9-7e0ec3a7ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.815416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665218-1d4d-49e8-b6c9-7e0ec3a7ab3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.816684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a665218-1d4d-49e8-b6c9-7e0ec3a7ab3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:13.820632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a665218-1d4d-49e8-b6c9-7e0ec3a7ab3a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:13.830873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 802/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:13.832637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.833116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.833404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.854330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.855623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.866976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 774/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/projects => generated 405 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:13.866976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:13.866976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:13.866976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:13.893234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] MFA Rules not processed for user `18f4b2c24c4f4e84970cd37f66397288`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:13.894467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:13.915343 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:13.932280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 803/1577] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.938233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:13.949193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:13.950667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc3d51-0566-412d-a4f9-82ae9a3c21ac None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:13.983287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 775/1578] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:13.984852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.016473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.017309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.017716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.018051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.019017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.021260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.051894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 804/1579] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.052557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.068359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159904d-fa5a-4d5e-884d-84215ce72214 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.138080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9480d3-bc1b-49e3-951c-101ac0096ccf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.140277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.140959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.141233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.141502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.142197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.144319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.144536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.145165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.145448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.145719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.146429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.148434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.174351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 805/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.175055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.187763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 776/1581] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:13 2022] POST /identity/v3/projects => generated 357 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.187763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.192060 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2fa7-88d8-487c-bfb7-203313a90ea3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.278830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.279881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.280333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.280801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.281704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.284469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.285974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749115f-549e-48ec-b7d9-201bad650b30 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.292895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.293661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.293909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.294091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.294814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.296842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.304668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:14.319382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 777/1582] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.320287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.323829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 806/1583] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.325113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.328901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:14.329404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:14.332144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388edbb3-d2b6-4f86-896f-8e89f87589de admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.412571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ea121-8f49-4420-87b5-bcd075c28697 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.417489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.418048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.418615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.419160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.428570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.429681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.430157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.430587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.431758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.435557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.464113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 778/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 303 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.464951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.475933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43bc17-7be3-4484-9493-a6a55b10c65e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.481076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.481864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.482076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.482352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.483079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.485067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.502782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.505273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.515074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 779/1585] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.515074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.520333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 807/1586] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:14.520333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.534217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe8cff-f7dc-4bf0-8a71-5e7f172bb0d8 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.609941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83b563-b32f-4d7a-a8db-47f80daecaf0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.617046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.618295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.618648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.619016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.620351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.622425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.647902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 780/1587] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.648545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.656514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.657646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.658138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.658605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.661274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.661537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43bdf-8fb7-4b11-a494-6f7bb0435dd3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.664689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.675628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.676454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.676805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.677143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.677957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.680095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.695627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 808/1588] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.695627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.714141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 781/1589] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 279 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.714491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f3fd-9bd8-49cf-8deb-c77f4518b877 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.714663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.720054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.721228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.721673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.722335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.723917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.727992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.731488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf89794-e8e3-4214-b680-331159682d7f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.738426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.740300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.740757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.741182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.742308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.745904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.749223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 809/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.750482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.768852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc4c17-f2ae-4744-b3db-9ce17ca322b5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.775737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.776666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.776908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.777215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.778046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.779859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.783393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 782/1591] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 294 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.784822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.793329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 810/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.794197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.802315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60578ae8-487b-400b-adb9-8129e94cbbbb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.808074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.808675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.809029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.809378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.810651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.812369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.816574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfe6e4-abf2-48dc-ae9c-bb92ce3e59dc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.826267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.827678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.828161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.828740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.830757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.834178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.841833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 783/1593] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:14 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:14.843235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.857523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 811/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.861685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.866904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f48e5-1d22-45b5-9e57-f379a728b570 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.879705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.881237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.881390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5e30-346c-4248-aac4-e16e3c60ed76 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.881903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.882487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.884170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.887338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.890069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=84,keystone:INSERT=16 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:14.891200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.896835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.896835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.898837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.904668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.915587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.919341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 784/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.919625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:14.921843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.935705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 812/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.940978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1840e3-72aa-4eca-ba74-44c2d0ab3d85 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.942178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.953864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.954753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.955253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.955631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.956475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.958228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.960677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aa73f-c44e-463e-8f30-1dbd724d9847 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:14.969565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:14.971548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:14.972489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:14.972489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:14.975527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:14.977868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:14.978920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 785/1597] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:14.978920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:14.995785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb4d83-b5d5-4868-96b5-8a97236382b3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.000323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 813/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:15.001661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.005885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.006698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.007111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.007539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.008365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.010149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.017000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75efd7-da14-48fd-9f0e-d46e00074a30 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.022606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.023527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.025498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.025498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.025498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.026929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.031662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 786/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:15.032965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.048488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 814/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:15.049672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.053983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08738b-23b4-4537-bdaf-d5bcdd87bcc8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.060110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.060831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.061133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.061401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.062438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.065285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.070311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a6b1-e46f-45cf-9694-93dfef02dcf7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.078271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.079597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.079998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.080281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] PATH_INFO: `/v3/projects/2be2fa57e1194b88a79fd1fc10ca2dd6/users/71faa4cc60f74a089fdf763ba13f56fa/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.088427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 787/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:15.088427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.107019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be2fa57e1194b88a79fd1fc10ca2dd6, user_id=71faa4cc60f74a089fdf763ba13f56fa, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.109569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9421e-ceec-4383-8c62-549e2d96296f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.110267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.119665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.120811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.121818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.122242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.124109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.127729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.130897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 815/1602] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/2be2fa57e1194b88a79fd1fc10ca2dd6/users/71faa4cc60f74a089fdf763ba13f56fa/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:15.132195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.149986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 788/1603] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:15.151887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.166265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ada67-3c71-4fb8-8c62-748c7207b9dc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.226131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d344e3-5861-4d0e-869f-10ebe123da6e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.232700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.233371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.233809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.234136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] PATH_INFO: `/v3/projects/19db983ea35a406ca961d25607feafbc/users/c19ef0f3b6d54d5286ab5dc4934e67be/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.254266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19db983ea35a406ca961d25607feafbc, user_id=c19ef0f3b6d54d5286ab5dc4934e67be, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.257214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.284942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 816/1604] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/19db983ea35a406ca961d25607feafbc/users/c19ef0f3b6d54d5286ab5dc4934e67be/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:15.284942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.292865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.293934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.294404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.294915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.296341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.298523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.316344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 789/1605] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:15.323774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.341472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62242d87-fc69-4796-96cf-28d7aa4029f4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.389623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5992-ff8d-4506-b90b-4675417df51a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.396914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.398216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.398492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.398760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] PATH_INFO: `/v3/projects/118631ca21b44452ab4773c68211dd36/users/0898ab34ae8c40b288af5ff8acc7c3d3/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.421445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118631ca21b44452ab4773c68211dd36, user_id=0898ab34ae8c40b288af5ff8acc7c3d3, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.424969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.444964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 817/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/118631ca21b44452ab4773c68211dd36/users/0898ab34ae8c40b288af5ff8acc7c3d3/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:15.446591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.477488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae863-e73e-4a1e-a716-3d8020da3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.479126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae863-e73e-4a1e-a716-3d8020da3345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.479625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae863-e73e-4a1e-a716-3d8020da3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.480120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae863-e73e-4a1e-a716-3d8020da3345 admin admin] PATH_INFO: `/v3/projects/299217d78d4d4a9ea015d5828e3c006b/users/617b6d211d884b5d9dfe5d35b26a6379/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.485192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:15.521594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae863-e73e-4a1e-a716-3d8020da3345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299217d78d4d4a9ea015d5828e3c006b, user_id=617b6d211d884b5d9dfe5d35b26a6379, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.526457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae863-e73e-4a1e-a716-3d8020da3345 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.550127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 790/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/299217d78d4d4a9ea015d5828e3c006b/users/617b6d211d884b5d9dfe5d35b26a6379/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:15.550127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.550127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.550127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.565096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d527-da22-4a4b-940a-4495b6f1cc63 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.571392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:15.573241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:15.637613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:15.703406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a8011-5044-4cd4-a791-76cd1cf15ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.705465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a8011-5044-4cd4-a791-76cd1cf15ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.706161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a8011-5044-4cd4-a791-76cd1cf15ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.706785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a8011-5044-4cd4-a791-76cd1cf15ffb admin admin] PATH_INFO: `/v3/projects/5beafcfea7d846bf96a0e516f685c713/users/14c68f694ed84ca5b505cda28e252f67/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.728314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 791/1608] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:15.729665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.738158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a8011-5044-4cd4-a791-76cd1cf15ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5beafcfea7d846bf96a0e516f685c713, user_id=14c68f694ed84ca5b505cda28e252f67, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.741914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a8011-5044-4cd4-a791-76cd1cf15ffb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.749050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9469d-405a-4ee8-8301-4b043ee7248a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.758088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.759757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.760231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.760707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] PATH_INFO: `/v3/projects/df118f16df4548f0808ed9e0c65bdd3a/users/d74a1ea477024402a7870c223c9a44c4/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.784050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 818/1609] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/5beafcfea7d846bf96a0e516f685c713/users/14c68f694ed84ca5b505cda28e252f67/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:15.786977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78107-ae8e-44d6-b551-0289e42d9a54 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.792972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=df118f16df4548f0808ed9e0c65bdd3a, user_id=d74a1ea477024402a7870c223c9a44c4, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:15.794462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78107-ae8e-44d6-b551-0289e42d9a54 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.794913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78107-ae8e-44d6-b551-0289e42d9a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.795594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:15.828530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 792/1610] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/df118f16df4548f0808ed9e0c65bdd3a/users/d74a1ea477024402a7870c223c9a44c4/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:15.828530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:15.859872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-acb78107-ae8e-44d6-b551-0289e42d9a54 None None] MFA Rules not processed for user `c19ef0f3b6d54d5286ab5dc4934e67be`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:15.862724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-acb78107-ae8e-44d6-b551-0289e42d9a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:15.957590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cda4-c340-4eeb-9811-45ec7453d1fa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:15.963677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:15.965301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:15.965694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:15.966068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] PATH_INFO: `/v3/projects/6b1cc5366ebc4cdd858e4e847d384ab4/users/27677feb06384469994cf5706f482e09/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:15.998042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1cc5366ebc4cdd858e4e847d384ab4, user_id=27677feb06384469994cf5706f482e09, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:16.005648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:16.016066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 819/1611] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:16.018260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.018725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.024603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.067502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 793/1612] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:15 2022] PUT /identity/v3/projects/6b1cc5366ebc4cdd858e4e847d384ab4/users/27677feb06384469994cf5706f482e09/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:16.068623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] MFA Rules not processed for user `0898ab34ae8c40b288af5ff8acc7c3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:16.069178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.071260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:16.134736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:16.186417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 820/1613] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:16.193392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.209767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdc914-c1e5-4804-bb35-1623fb6789d3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.217993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c469b1-02ec-442f-9ab3-1e0ca710ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:16.219189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c469b1-02ec-442f-9ab3-1e0ca710ba96 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.219678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c469b1-02ec-442f-9ab3-1e0ca710ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.220164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c469b1-02ec-442f-9ab3-1e0ca710ba96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.221565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c469b1-02ec-442f-9ab3-1e0ca710ba96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:16.224782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c469b1-02ec-442f-9ab3-1e0ca710ba96 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:16.250088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 794/1614] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:16.250088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf31fe-0b40-41b9-aad6-b1213a177c14 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.250088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf31fe-0b40-41b9-aad6-b1213a177c14 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.250088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf31fe-0b40-41b9-aad6-b1213a177c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.288990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad24a04-d617-4532-bf0a-ec7932aaa7a1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.296164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ecf59-a4ff-4741-b148-71fbc1e3229b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:16.297455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ecf59-a4ff-4741-b148-71fbc1e3229b service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.297737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b4cf31fe-0b40-41b9-aad6-b1213a177c14 None None] MFA Rules not processed for user `14c68f694ed84ca5b505cda28e252f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:16.298205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ecf59-a4ff-4741-b148-71fbc1e3229b service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.298770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ecf59-a4ff-4741-b148-71fbc1e3229b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.299898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b4cf31fe-0b40-41b9-aad6-b1213a177c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:16.317491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ecf59-a4ff-4741-b148-71fbc1e3229b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:16.320432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ecf59-a4ff-4741-b148-71fbc1e3229b service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:16.326677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:16.341680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 821/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:16.344293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.344872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.345408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.398454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] MFA Rules not processed for user `d74a1ea477024402a7870c223c9a44c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:16.400880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:16.431054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 795/1616] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:16.431918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572098c5-2169-4bbe-b699-7d41d5a71a1d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.432246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572098c5-2169-4bbe-b699-7d41d5a71a1d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.432530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572098c5-2169-4bbe-b699-7d41d5a71a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.466417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-572098c5-2169-4bbe-b699-7d41d5a71a1d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:16.469695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-572098c5-2169-4bbe-b699-7d41d5a71a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:16.495101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 796/1617] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:16.497995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874591d1-ca17-49c2-b28e-dfbb8eef6d5f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.498661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874591d1-ca17-49c2-b28e-dfbb8eef6d5f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.499330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874591d1-ca17-49c2-b28e-dfbb8eef6d5f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.505198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 797/1618] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 22:38:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:16.507475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874591d1-ca17-49c2-b28e-dfbb8eef6d5f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.540445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874591d1-ca17-49c2-b28e-dfbb8eef6d5f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.552113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:16.554514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.555187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.555779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.560280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 822/1619] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:16.560464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:16.560580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.562849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:16.586280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0831252-4b42-452b-a3c8-4f51b3cbd8d3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.601527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796046c2-8eda-4d25-9584-b67b15650d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:16.603176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796046c2-8eda-4d25-9584-b67b15650d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.603677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796046c2-8eda-4d25-9584-b67b15650d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.604131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796046c2-8eda-4d25-9584-b67b15650d78 admin admin] PATH_INFO: `/v3/projects/299217d78d4d4a9ea015d5828e3c006b/users/617b6d211d884b5d9dfe5d35b26a6379/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.608262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 798/1620] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:16.609959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.616344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796046c2-8eda-4d25-9584-b67b15650d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299217d78d4d4a9ea015d5828e3c006b, user_id=617b6d211d884b5d9dfe5d35b26a6379, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:16.623309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796046c2-8eda-4d25-9584-b67b15650d78 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:16.671040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 823/1621] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:16 2022] PUT /identity/v3/projects/299217d78d4d4a9ea015d5828e3c006b/users/617b6d211d884b5d9dfe5d35b26a6379/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:16.671040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.671040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.671040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.698295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02590-212e-4ee0-823b-6b572c224479 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.775133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:16.775450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:16.776012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.776201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.776471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:16.776636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:16.777546 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:16.780191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:16.815753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:16.816054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 799/1622] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:16.816829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.850046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:16.879009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 824/1623] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:16.880495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:16.894535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a75a9-2090-44f1-be69-a8ce4c0068c3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.930959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e0482-eb93-494c-a138-42671c5a9231 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:16.938130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:16.939315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:16.940834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:16.941243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.003542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236053ec-7c16-4529-b8b9-928c06e9cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.005040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236053ec-7c16-4529-b8b9-928c06e9cdcc admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.005719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236053ec-7c16-4529-b8b9-928c06e9cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.006262 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236053ec-7c16-4529-b8b9-928c06e9cdcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.008080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236053ec-7c16-4529-b8b9-928c06e9cdcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.013255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236053ec-7c16-4529-b8b9-928c06e9cdcc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.032114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.033607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.048068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 800/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:17.048963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.061231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f64790-d9c1-42f9-97bd-1ee4a956da61 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.066825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.067733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.068020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.068290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.068996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.070981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.085887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 825/1625] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:16 2022] POST /identity/v3/projects => generated 357 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:17.088912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.091055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.092259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.102824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 801/1626] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:17 2022] POST /identity/v3/users => generated 309 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:17.107663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.127537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf762c7-f251-45fa-8d5f-8f515a7bb036 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.210294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] MFA Rules not processed for user `617b6d211d884b5d9dfe5d35b26a6379`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:17.213655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:17.214564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.216052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.216558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.217153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.218193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.220682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.259206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 802/1627] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:17 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:17.260208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.326017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:17.371232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4c150-ab21-4d3c-a368-493f779e9676 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.378281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.380010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.380010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.380010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.406093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 826/1628] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:17.406093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.433909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aba9ab-ea40-43e5-8f0b-a531935e4174 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.447705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.448822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.450071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.451564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.459339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.464056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.508237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.510443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.525669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 827/1629] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:17 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:17.526400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 803/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:17.531729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.537960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.547176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2d96-e074-4c7f-b776-657fb6bffdd3 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.554919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.556117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.556745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.557253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.558414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.560978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.654762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 804/1631] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:17.654762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.663809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f927-7306-4a3b-a9cd-92d0171fe880 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.663809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.663809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.663809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.664804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.664804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.664804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.705445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 828/1632] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:17.705445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.737600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe129c45-3263-48d5-9803-fc14cb78a80a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.758102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.761232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa3b0-deae-46b4-9533-f2113e9ba0ef admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.762522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.763078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.763508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.765340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.770333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.773000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:17.785615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.787022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.787491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.788923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.826387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 829/1633] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:17.828554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.830509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.834064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.861535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd707f4-dd0d-4c2f-9f9e-5223264da672 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.870399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 805/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:17.872131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:17.884068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.885553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.886011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.886453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] PATH_INFO: `/v3/projects/6f75ca3457f44cd095775ed86508a493/users/5308cc23e6c94a8ab3309fd50732664f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.912988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27275831-d092-4e7f-b8b5-abea96c6b158 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:17.937383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f75ca3457f44cd095775ed86508a493, user_id=5308cc23e6c94a8ab3309fd50732664f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:17.937849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:17.943606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:17.944335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:17.945385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:17.946970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] PATH_INFO: `/v3/projects/a56d3843eaab42e3a9ffae074fe67e68/users/9a4bfd7fa6db46ec81062e02336a27a0/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:17.970156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 830/1635] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:17 2022] PUT /identity/v3/projects/6f75ca3457f44cd095775ed86508a493/users/5308cc23e6c94a8ab3309fd50732664f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:17.971327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:18.020725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56d3843eaab42e3a9ffae074fe67e68, user_id=9a4bfd7fa6db46ec81062e02336a27a0, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:18.026388 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:18.061214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 806/1636] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:17 2022] PUT /identity/v3/projects/a56d3843eaab42e3a9ffae074fe67e68/users/9a4bfd7fa6db46ec81062e02336a27a0/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:18.063689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:18.071795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ac25d-302e-4fcf-9b06-8247985def7a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:18.185231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:18.216153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:18.220716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.221781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.222459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] PATH_INFO: `/v3/projects/5d9700a882fc46b6a4839946c101bd0a/users/040d2a37063a42bc908b39d528c621b1/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.241914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db071-9d90-4c9c-906f-9222c11c17bd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:18.251257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed0843-96d3-4581-a86d-4e01f1c5f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:18.253119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed0843-96d3-4581-a86d-4e01f1c5f4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.253816 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed0843-96d3-4581-a86d-4e01f1c5f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.254380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9700a882fc46b6a4839946c101bd0a, user_id=040d2a37063a42bc908b39d528c621b1, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:18.254824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed0843-96d3-4581-a86d-4e01f1c5f4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.256560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed0843-96d3-4581-a86d-4e01f1c5f4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:18.261795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:18.262135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed0843-96d3-4581-a86d-4e01f1c5f4e5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:18.288796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 807/1637] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:18.292238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330acfd-74d3-4ce4-998f-bc8cc653c3d4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.293005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330acfd-74d3-4ce4-998f-bc8cc653c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.294807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330acfd-74d3-4ce4-998f-bc8cc653c3d4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.295845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 831/1638] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:17 2022] PUT /identity/v3/projects/5d9700a882fc46b6a4839946c101bd0a/users/040d2a37063a42bc908b39d528c621b1/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:18.298883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 808/1639] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 22:38:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:18.301084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330acfd-74d3-4ce4-998f-bc8cc653c3d4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:18.307179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:18.548484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637146-b5e9-4321-bb51-3b986a2b19ca admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:18.561821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330acfd-74d3-4ce4-998f-bc8cc653c3d4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:18.568018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:18.569104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.569557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.570001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.572254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:18.577796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:18.578862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.579350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.579795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.585028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:18.595830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:18.658226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 832/1640] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:18.664530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:18.711880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da828ec4-7399-48c6-9417-695a0c9aa981 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:18.739091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc801-4c8c-4e23-8ebe-016cb1ddadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:18.741432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc801-4c8c-4e23-8ebe-016cb1ddadea admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.744450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc801-4c8c-4e23-8ebe-016cb1ddadea admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.745805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc801-4c8c-4e23-8ebe-016cb1ddadea admin admin] PATH_INFO: `/v3/projects/6f75ca3457f44cd095775ed86508a493/users/5308cc23e6c94a8ab3309fd50732664f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.755992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc801-4c8c-4e23-8ebe-016cb1ddadea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f75ca3457f44cd095775ed86508a493, user_id=5308cc23e6c94a8ab3309fd50732664f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:18.762249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:18.766119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:18.772034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc801-4c8c-4e23-8ebe-016cb1ddadea admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:18.794351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 809/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:18.796881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:18.824239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 833/1642] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:18 2022] PUT /identity/v3/projects/6f75ca3457f44cd095775ed86508a493/users/5308cc23e6c94a8ab3309fd50732664f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:18.831103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:18.832266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:18.834358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:18.840726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd814-0d30-4bc5-b725-cc11b622ee0c service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:18.932763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:18.936933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:18.997997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:19.000831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.001109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.001382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.005221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:19.007031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:19.033371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 810/1643] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:19.036222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:19.057814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb13cdf-517f-46f3-afbd-49573e4a9b64 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:19.070193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9b912-f728-4a3f-9005-af29e44fa119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:19.072724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9b912-f728-4a3f-9005-af29e44fa119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.073003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9b912-f728-4a3f-9005-af29e44fa119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.073265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9b912-f728-4a3f-9005-af29e44fa119 admin admin] PATH_INFO: `/v3/projects/a56d3843eaab42e3a9ffae074fe67e68/users/9a4bfd7fa6db46ec81062e02336a27a0/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.076832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9b912-f728-4a3f-9005-af29e44fa119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56d3843eaab42e3a9ffae074fe67e68, user_id=9a4bfd7fa6db46ec81062e02336a27a0, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:19.079645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9b912-f728-4a3f-9005-af29e44fa119 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:19.109300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 811/1644] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:19 2022] PUT /identity/v3/projects/a56d3843eaab42e3a9ffae074fe67e68/users/9a4bfd7fa6db46ec81062e02336a27a0/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:19.114506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.114840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.115073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.126538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 834/1645] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:19.127479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:19.152619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa26df3-a721-405f-ae77-53d6cd53298c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:19.173598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] MFA Rules not processed for user `5308cc23e6c94a8ab3309fd50732664f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:19.174931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:19.189460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:19.256848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031702-5e03-4bb2-a1e8-9854d149a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:19.257868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031702-5e03-4bb2-a1e8-9854d149a1be admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.258237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031702-5e03-4bb2-a1e8-9854d149a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.258609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031702-5e03-4bb2-a1e8-9854d149a1be admin admin] PATH_INFO: `/v3/projects/5d9700a882fc46b6a4839946c101bd0a/users/040d2a37063a42bc908b39d528c621b1/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.261599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4031702-5e03-4bb2-a1e8-9854d149a1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9700a882fc46b6a4839946c101bd0a, user_id=040d2a37063a42bc908b39d528c621b1, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:19.265396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4031702-5e03-4bb2-a1e8-9854d149a1be admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:19.289791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 835/1646] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:19 2022] PUT /identity/v3/projects/5d9700a882fc46b6a4839946c101bd0a/users/040d2a37063a42bc908b39d528c621b1/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:19.293848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c3d9-53bd-40fe-a765-64739350dd39 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.294496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c3d9-53bd-40fe-a765-64739350dd39 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.295187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c3d9-53bd-40fe-a765-64739350dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.335960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 812/1647] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:19.341272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:19.359803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6da3c3d9-53bd-40fe-a765-64739350dd39 None None] MFA Rules not processed for user `9a4bfd7fa6db46ec81062e02336a27a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:19.361074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6da3c3d9-53bd-40fe-a765-64739350dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:19.477124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45784e3f-961a-46f4-8f82-b2b4041f923a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:19.522280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:19.544163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 836/1648] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:19.547035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.548922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.548922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.642724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:19.645349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.646656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.647463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.656936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] MFA Rules not processed for user `040d2a37063a42bc908b39d528c621b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:19.658385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:19.795482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:19.799420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:19.880593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 837/1649] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:19.883875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 813/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:19.906056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:19.924042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a6af-ebfe-430f-9188-4130711363f8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:19.928580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:19.929510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.929953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.930425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:20.064492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:20.066012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:20.103877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 838/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:20.141418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:20.150887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:20.152187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:20.163145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa0c75-ce80-427f-91b4-565b604aad03 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:20.175238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:20.176599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:20.176879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:20.177148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:20.203378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:20.205771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:20.240810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 839/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:20 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:38:20.521879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc657e51-0177-4ae8-aa2d-f05e51f939ba service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:20.531873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:20.532537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:20.535377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:20.535898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:20.537450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] PATH_INFO: `/v3/users/14c68f694ed84ca5b505cda28e252f67` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:20.540070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c68f694ed84ca5b505cda28e252f67)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:20.545221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:20.562101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6fd0-5915-49d9-ab06-d130d0177d17 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:20.573767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff7e4d-b99e-4014-b283-b322bef8ebc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:20.575597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7e4d-b99e-4014-b283-b322bef8ebc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:20.577325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7e4d-b99e-4014-b283-b322bef8ebc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:20.578084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7e4d-b99e-4014-b283-b322bef8ebc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:20.620334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff7e4d-b99e-4014-b283-b322bef8ebc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:20.624191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff7e4d-b99e-4014-b283-b322bef8ebc2 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:20.689052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 840/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:38:20.705957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c68f694ed84ca5b505cda28e252f67'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:20.721246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c68f694ed84ca5b505cda28e252f67'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:20.722012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c68f694ed84ca5b505cda28e252f67'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:20.743572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c68f694ed84ca5b505cda28e252f67'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:20.791824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c68f694ed84ca5b505cda28e252f67'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:20.811209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 814/1654] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:20 2022] DELETE /identity/v3/users/14c68f694ed84ca5b505cda28e252f67 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:20.817886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:20.819884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:20.821364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:20.862854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:20.872319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:20.985438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:21.039805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 841/1655] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:21.062323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:21.064277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:21.244824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d1da-3740-4c14-86de-b27ab6b4716f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:21.260879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e199-5274-47bb-afc8-0d2f8c75ebb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:21.261458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e199-5274-47bb-afc8-0d2f8c75ebb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:21.261882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e199-5274-47bb-afc8-0d2f8c75ebb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:21.262165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e199-5274-47bb-afc8-0d2f8c75ebb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:21.295069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174e199-5274-47bb-afc8-0d2f8c75ebb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:21.301010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174e199-5274-47bb-afc8-0d2f8c75ebb9 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:21.360191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 815/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:38:21.402012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:21.405431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:21.550871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a429f-3faf-443f-8338-0bce3b1880d3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:21.560551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:21.561675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:21.562199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:21.565852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:21.571348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:21.775483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:21.783358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:21.828678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 842/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:38:22.245732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67299-4f63-4b29-9c4e-cd89f19af34c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.246564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67299-4f63-4b29-9c4e-cd89f19af34c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.246564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67299-4f63-4b29-9c4e-cd89f19af34c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.248713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 816/1658] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 22:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:38:22.268748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:22.272865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.276504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63125-cd87-49a7-8053-50a269394ad9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.277019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63125-cd87-49a7-8053-50a269394ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.277428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63125-cd87-49a7-8053-50a269394ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.360338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2754ecd-1544-4c5e-8b07-f9b63138122a service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:22.393931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9ae63125-cd87-49a7-8053-50a269394ad9 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:22.410040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9ae63125-cd87-49a7-8053-50a269394ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.417795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23105a-4326-4086-b938-052365a851af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:22.425873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23105a-4326-4086-b938-052365a851af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.426348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23105a-4326-4086-b938-052365a851af admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.426742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23105a-4326-4086-b938-052365a851af admin admin] PATH_INFO: `/v3/users/0898ab34ae8c40b288af5ff8acc7c3d3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.433760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23105a-4326-4086-b938-052365a851af admin admin] RBAC: Authorizing `identity:delete_user(user_id=0898ab34ae8c40b288af5ff8acc7c3d3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:22.436499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: WARNING py.warnings [None req-8d23105a-4326-4086-b938-052365a851af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:38:22.436499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: warnings.warn(msg) Jul 21 22:38:22.436499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: Jul 21 22:38:22.438185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23105a-4326-4086-b938-052365a851af admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:22.467591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:22.590810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 817/1659] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 22:38:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 21 22:38:22.601446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84e48-9d5a-4b46-a6a5-9fdc1ba0a1e1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.602098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84e48-9d5a-4b46-a6a5-9fdc1ba0a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.602655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84e48-9d5a-4b46-a6a5-9fdc1ba0a1e1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.605406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 818/1660] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 22:38:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:38:22.613236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.614120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.614654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.630839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8d23105a-4326-4086-b938-052365a851af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0898ab34ae8c40b288af5ff8acc7c3d3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:22.663061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8d23105a-4326-4086-b938-052365a851af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0898ab34ae8c40b288af5ff8acc7c3d3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:22.663061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8d23105a-4326-4086-b938-052365a851af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0898ab34ae8c40b288af5ff8acc7c3d3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:22.674700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:22.676058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.702233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8d23105a-4326-4086-b938-052365a851af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0898ab34ae8c40b288af5ff8acc7c3d3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:22.704172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 819/1661] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:22.705675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8d23105a-4326-4086-b938-052365a851af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0898ab34ae8c40b288af5ff8acc7c3d3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:22.718931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:22.720435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.742093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1625-101b-4ad9-b7d6-469f758824cb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:22.747582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:22.748923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.749457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.750687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.773248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:22.777142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:22.805265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 843/1662] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:22 2022] DELETE /identity/v3/users/0898ab34ae8c40b288af5ff8acc7c3d3 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:22.807605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.807605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.807605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.827640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 820/1663] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:22.850767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:22.854525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.878918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:23.160619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 844/1664] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:23.357481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:23.364138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:23.368045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:23.374576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:23.447861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35660a68-b740-4af7-bfcc-d887b158c2f0 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:23.451394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d6056-0cc4-41c3-8bd4-d37748cb8df3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:23.492316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:23.493408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:23.494040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:23.498096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] PATH_INFO: `/v3/projects/5beafcfea7d846bf96a0e516f685c713` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:23.507952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5beafcfea7d846bf96a0e516f685c713)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:23.512856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:23.781680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5beafcfea7d846bf96a0e516f685c713', 'request_id': 'req-cd57b062-75e7-4b0f-a590-e5c0e703659d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:23.808494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5beafcfea7d846bf96a0e516f685c713', 'request_id': 'req-cd57b062-75e7-4b0f-a590-e5c0e703659d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:23.863060 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5beafcfea7d846bf96a0e516f685c713', 'request_id': 'req-cd57b062-75e7-4b0f-a590-e5c0e703659d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:23.914501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] The token cache is being invalidate because project 5beafcfea7d846bf96a0e516f685c713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:23.914846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:23.919328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:23.931489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 845/1665] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:23 2022] DELETE /identity/v3/projects/5beafcfea7d846bf96a0e516f685c713 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:23.933689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:23.934757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:23.941452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:23.942653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:23.943229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:23.943797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:23.954955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:24.037479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:24.042716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:24.084507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 821/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:24.330599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b062-75e7-4b0f-a590-e5c0e703659d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:24.345738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:24.346136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:24.346332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:24.346615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] PATH_INFO: `/v3/users/5308cc23e6c94a8ab3309fd50732664f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:24.351424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5308cc23e6c94a8ab3309fd50732664f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:24.356732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:24.522691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:24.550186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5308cc23e6c94a8ab3309fd50732664f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:24.576028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5308cc23e6c94a8ab3309fd50732664f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:24.577562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5308cc23e6c94a8ab3309fd50732664f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:24.610551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5308cc23e6c94a8ab3309fd50732664f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:24.613910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57882458-ad29-4ce5-a503-4194f9cfbd12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5308cc23e6c94a8ab3309fd50732664f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:24.720048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 846/1667] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:23 2022] DELETE /identity/v3/users/5308cc23e6c94a8ab3309fd50732664f => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:26.883848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:26.913955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add728e-ca4f-446b-9229-64ffb6c73aeb service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:27.258231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:27.259964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:27.271821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:27.272392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] PATH_INFO: `/v3/projects/6f75ca3457f44cd095775ed86508a493` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:27.277865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f75ca3457f44cd095775ed86508a493)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:27.282678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: WARNING py.warnings [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:38:27.282678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: warnings.warn(msg) Jul 21 22:38:27.282678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: Jul 21 22:38:27.288996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:27.590644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:27.631186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76063f0-50ac-4510-bbda-04fb0e9f5baa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:27.632671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76063f0-50ac-4510-bbda-04fb0e9f5baa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:27.633410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76063f0-50ac-4510-bbda-04fb0e9f5baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:27.641002 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f75ca3457f44cd095775ed86508a493', 'request_id': 'req-76d8c033-1a3a-440a-aafc-29074e0b4ab9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:27.664685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f75ca3457f44cd095775ed86508a493', 'request_id': 'req-76d8c033-1a3a-440a-aafc-29074e0b4ab9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:27.684356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f75ca3457f44cd095775ed86508a493', 'request_id': 'req-76d8c033-1a3a-440a-aafc-29074e0b4ab9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:27.741456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] The token cache is being invalidate because project 6f75ca3457f44cd095775ed86508a493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:27.741936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:27.746457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d76063f0-50ac-4510-bbda-04fb0e9f5baa None None] MFA Rules not processed for user `c2e2a3ec4d0a43479b487e5faaf9a233`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:27.746754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-76d8c033-1a3a-440a-aafc-29074e0b4ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:27.748570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d76063f0-50ac-4510-bbda-04fb0e9f5baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:27.752372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 822/1668] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:26 2022] DELETE /identity/v3/projects/6f75ca3457f44cd095775ed86508a493 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:27.753902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:27.754191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:27.754465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:27.789655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:27.791089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:27.941672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 823/1669] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:27.942839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:27.944761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:27.961005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d83bf2-39b2-4c7c-bcf3-4d5f421473f8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:27.973765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:27.974827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:27.975659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:27.976314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] PATH_INFO: `/v3/projects/118631ca21b44452ab4773c68211dd36` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:27.978679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] RBAC: Authorizing `identity:delete_project(project_id=118631ca21b44452ab4773c68211dd36)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:27.982821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:28.026702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 847/1670] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:38:28.028672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:28.028672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:28.030305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:28.092350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:28.093764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.173933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118631ca21b44452ab4773c68211dd36', 'request_id': 'req-e031fb47-d3a4-4416-b32b-424dd8ad718a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.185652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118631ca21b44452ab4773c68211dd36', 'request_id': 'req-e031fb47-d3a4-4416-b32b-424dd8ad718a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.196730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118631ca21b44452ab4773c68211dd36', 'request_id': 'req-e031fb47-d3a4-4416-b32b-424dd8ad718a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.256621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] The token cache is being invalidate because project 118631ca21b44452ab4773c68211dd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:28.257236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.260584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e031fb47-d3a4-4416-b32b-424dd8ad718a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.267265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 824/1671] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:27 2022] DELETE /identity/v3/projects/118631ca21b44452ab4773c68211dd36 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:28.270568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:28.271437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:28.272297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:28.320591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] MFA Rules not processed for user `c2e2a3ec4d0a43479b487e5faaf9a233`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:28.335631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.410850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 848/1672] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:28.413699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:28.417368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.438888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9212a20-3147-4700-9680-f75d80e8c63c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:28.447331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:28.449371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:28.450087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:28.452160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] PATH_INFO: `/v3/users/9a4bfd7fa6db46ec81062e02336a27a0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:28.454939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4bfd7fa6db46ec81062e02336a27a0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:28.458401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:28.554977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:28.589026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:28.589477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 825/1673] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:28.590495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:28.595282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.598567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4bfd7fa6db46ec81062e02336a27a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.625125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4bfd7fa6db46ec81062e02336a27a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.628614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4bfd7fa6db46ec81062e02336a27a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.642507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a21b9-8a36-4f2a-b9a5-700a2659e7cd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:28.656578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:28.658058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:28.661536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:28.661881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] PATH_INFO: `/v3/users/c19ef0f3b6d54d5286ab5dc4934e67be` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:28.663337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19ef0f3b6d54d5286ab5dc4934e67be)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:28.664198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4bfd7fa6db46ec81062e02336a27a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.665228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4bfd7fa6db46ec81062e02336a27a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.668329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:28.715297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 849/1674] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:28 2022] DELETE /identity/v3/users/9a4bfd7fa6db46ec81062e02336a27a0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:28.715498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:28.720645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.776665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19ef0f3b6d54d5286ab5dc4934e67be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.789238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19ef0f3b6d54d5286ab5dc4934e67be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.790889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19ef0f3b6d54d5286ab5dc4934e67be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.803073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19ef0f3b6d54d5286ab5dc4934e67be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.840868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19ef0f3b6d54d5286ab5dc4934e67be'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:28.859698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 826/1675] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:28 2022] DELETE /identity/v3/users/c19ef0f3b6d54d5286ab5dc4934e67be => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:28.860958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:28.867937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.951092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba2d30-ea10-49ae-8964-d594d02094f2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.156275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.157646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.160121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.160121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.161972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:29.161972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.167507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dd1b8-ecda-4c08-be6a-90159582ae7f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.171141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c06def-32d7-482f-9c64-8d06de0bce0e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.197350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.203501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.203501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.203833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.209172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 850/1676] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:29.210410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.213069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.213324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.218912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:29.258325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:29.263377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:29.304816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 851/1677] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:29.313498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:29.323909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:29.385416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98397-3251-4c8b-a625-0369d1e640f8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.402086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.403793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.404147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.404876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.405890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.410355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.463785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 852/1678] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:29 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:29.463785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:29.465732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:29.480435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.484642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.522821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 827/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:29.533856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:29.540408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:29.575474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614633a-3e4e-4442-8cf0-e9daeffb9816 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.582594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.583370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.583652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.583927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.599416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3170b-a615-4ed5-b5ba-95308e4af04f service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.611656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:29.696094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.698680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.713847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 853/1680] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:29.828351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.829260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.829666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.830160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.831503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.841037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.896818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:29.899627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:29.914232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 828/1681] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:29 2022] POST /identity/v3/users => generated 291 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:29.921346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:29.924750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a068de-7a6f-4387-aa51-3aea9f96cb0f service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.936747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728c319-ba3d-4de3-870c-caffbd0a6b81 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:29.940149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.941108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.941325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.941557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] PATH_INFO: `/v3/projects/a56d3843eaab42e3a9ffae074fe67e68` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.943594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56d3843eaab42e3a9ffae074fe67e68)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.945947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.954037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:29.954260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:29.954574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:29.954844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:29.960213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:29.962740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:29.989909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 829/1682] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:29.993798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:30.017035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cba1a6-e090-4d53-ad3a-95b0c0d58c9e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:30.032080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:30.035645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.036007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.036222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.036968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:30.044653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:30.074453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56d3843eaab42e3a9ffae074fe67e68', 'request_id': 'req-173d08a5-c77b-4a60-885f-1abf4091bc6c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:30.077403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 830/1683] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:30.085637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:30.096207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56d3843eaab42e3a9ffae074fe67e68', 'request_id': 'req-173d08a5-c77b-4a60-885f-1abf4091bc6c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:30.112437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162252-fd0a-42a6-a4e3-e98890458510 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:30.113346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56d3843eaab42e3a9ffae074fe67e68', 'request_id': 'req-173d08a5-c77b-4a60-885f-1abf4091bc6c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:30.147879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] The token cache is being invalidate because project a56d3843eaab42e3a9ffae074fe67e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:30.149623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:30.150641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173d08a5-c77b-4a60-885f-1abf4091bc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:30.153141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 854/1684] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:29 2022] DELETE /identity/v3/projects/a56d3843eaab42e3a9ffae074fe67e68 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:38:30.161265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31cee-9efd-4187-9b79-288113f0e586 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.161586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31cee-9efd-4187-9b79-288113f0e586 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.166177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc31cee-9efd-4187-9b79-288113f0e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.211886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ecc31cee-9efd-4187-9b79-288113f0e586 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:30.218741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ecc31cee-9efd-4187-9b79-288113f0e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:30.287697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bede4-7fb2-4f7a-a8c4-ecea80af412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:30.289029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bede4-7fb2-4f7a-a8c4-ecea80af412e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.289315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bede4-7fb2-4f7a-a8c4-ecea80af412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.289592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bede4-7fb2-4f7a-a8c4-ecea80af412e admin admin] PATH_INFO: `/v3/projects/27f3da9af8f6445096952e1b37b1d3ca/users/a5ecb7d3d1304405b71f5a25e86e97e2/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.332694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bede4-7fb2-4f7a-a8c4-ecea80af412e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f3da9af8f6445096952e1b37b1d3ca, user_id=a5ecb7d3d1304405b71f5a25e86e97e2, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:30.342739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bede4-7fb2-4f7a-a8c4-ecea80af412e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:30.373265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 831/1685] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:30 2022] PUT /identity/v3/projects/27f3da9af8f6445096952e1b37b1d3ca/users/a5ecb7d3d1304405b71f5a25e86e97e2/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:30.380512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.380801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.381088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.408141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 855/1686] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:30.412727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.418127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.418635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.444220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:30.457519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:30.458766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:30.489963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] MFA Rules not processed for user `a5ecb7d3d1304405b71f5a25e86e97e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:30.491266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:30.665625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:30.699466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 832/1687] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:30.712079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:30.741517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5c5f7-d8ec-4abc-9355-22d443ccc7de None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:30.747956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 856/1688] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:30.752623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:30.762830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:30.774298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:30.775398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.775796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.776060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.776907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:30.777147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:30.778772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:30.816946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e006e-1e1b-4d54-bacb-24e28a80866c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:30.830426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 833/1689] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:30.831575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:30.862901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:30.865993 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb99cb-43b0-467e-a41f-76d2a5097b63 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:30.879671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.880112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.885773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.885945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:30.886562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:30.886847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:30.887062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:30.887165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:30.887836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:30.890172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:30.896228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:30.985533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 834/1690] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:30 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:30.987025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:30.996523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:30.999768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 857/1691] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:30 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:31.001027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:31.146708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f0010-55f4-46df-b16f-c3b544b4c820 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:31.241432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02a4f-8e6b-4725-953f-fa1854b66c72 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:31.262047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:31.267341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.268654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.268654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.269482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:31.276608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:31.312679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:31.313600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.313876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.314147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] PATH_INFO: `/v3/users/18f4b2c24c4f4e84970cd37f66397288` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.319960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f4b2c24c4f4e84970cd37f66397288)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:31.322087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:31.327069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 858/1692] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:30 2022] POST /identity/v3/users => generated 302 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:31.327896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:31.406894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa712-b432-4410-b8a8-cb8e794489da admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:31.425934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:31.427665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.428048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.428512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.428609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f4b2c24c4f4e84970cd37f66397288'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.429682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:31.439666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f4b2c24c4f4e84970cd37f66397288'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.440330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f4b2c24c4f4e84970cd37f66397288'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.440691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:31.465270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f4b2c24c4f4e84970cd37f66397288'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.473879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:31.488751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-537a7e26-354b-46d2-8b48-6dd6d59e2c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f4b2c24c4f4e84970cd37f66397288'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.506298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 835/1693] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:30 2022] DELETE /identity/v3/users/18f4b2c24c4f4e84970cd37f66397288 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:31.507957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5029484-fd19-4b10-ab3d-74712e3c80a2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.508371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5029484-fd19-4b10-ab3d-74712e3c80a2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.508654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5029484-fd19-4b10-ab3d-74712e3c80a2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.510327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 836/1694] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 22:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:31.511079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5029484-fd19-4b10-ab3d-74712e3c80a2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:31.516838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 859/1695] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:31 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:31.518093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:31.519916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e5029484-fd19-4b10-ab3d-74712e3c80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:31.526145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:31.569922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8699e-fc05-4f7b-af01-a6fecd78b96d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:31.690095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5029484-fd19-4b10-ab3d-74712e3c80a2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:31.701710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:31.702673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.702951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.703253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] PATH_INFO: `/v3/projects/19db983ea35a406ca961d25607feafbc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.704541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19db983ea35a406ca961d25607feafbc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:31.706499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:31.722825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:31.773077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfaab9-6bc5-4ac1-be48-1b0d5d2dcbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:31.773845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfaab9-6bc5-4ac1-be48-1b0d5d2dcbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.774110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfaab9-6bc5-4ac1-be48-1b0d5d2dcbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.774389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfaab9-6bc5-4ac1-be48-1b0d5d2dcbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.775182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfaab9-6bc5-4ac1-be48-1b0d5d2dcbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:31.777479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfaab9-6bc5-4ac1-be48-1b0d5d2dcbe3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:31.815253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19db983ea35a406ca961d25607feafbc', 'request_id': 'req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.815951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 860/1696] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:31.822864 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19661425-37a4-4647-b2be-43a45743f866 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.823713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19661425-37a4-4647-b2be-43a45743f866 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.824007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19661425-37a4-4647-b2be-43a45743f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.833604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19db983ea35a406ca961d25607feafbc', 'request_id': 'req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.849187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19db983ea35a406ca961d25607feafbc', 'request_id': 'req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.878913 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] The token cache is being invalidate because project 19db983ea35a406ca961d25607feafbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:31.879246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.879978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:31.883212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 837/1697] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:31 2022] DELETE /identity/v3/projects/19db983ea35a406ca961d25607feafbc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:31.884059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:31.888953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:31.911071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-19661425-37a4-4647-b2be-43a45743f866 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:31.921555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-19661425-37a4-4647-b2be-43a45743f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.050823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6a6a3-ab46-4b66-b5b7-d9fef2232400 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:32.066716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982c7b-ae15-4894-89fb-5741d64d0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:32.067504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982c7b-ae15-4894-89fb-5741d64d0cba admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.067786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982c7b-ae15-4894-89fb-5741d64d0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.068060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982c7b-ae15-4894-89fb-5741d64d0cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.068818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982c7b-ae15-4894-89fb-5741d64d0cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:32.070521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982c7b-ae15-4894-89fb-5741d64d0cba admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:32.103072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 838/1698] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:32.103072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.103072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.103072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.134595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 861/1699] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:32.139589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19661425-37a4-4647-b2be-43a45743f866 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:32.154226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-19661425-37a4-4647-b2be-43a45743f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.188071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19661425-37a4-4647-b2be-43a45743f866 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:32.191418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:32.200172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083a97c-3c38-44ea-8be4-4255429f5997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:32.201318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083a97c-3c38-44ea-8be4-4255429f5997 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.203183 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083a97c-3c38-44ea-8be4-4255429f5997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.203483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083a97c-3c38-44ea-8be4-4255429f5997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.204269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083a97c-3c38-44ea-8be4-4255429f5997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:32.209540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:32.210679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083a97c-3c38-44ea-8be4-4255429f5997 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:32.210899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.242263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 862/1700] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:32.244276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.244699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.245090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.300166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:32.302255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.306803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 839/1701] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:32.307422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:32.329576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 863/1702] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:32.330704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed729-0c3e-4abc-8cb2-186d9afa834e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:32.338558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:32.339539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.340035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.340133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] PATH_INFO: `/v3/projects/702d647ba7dc4c1ea9aad4f4b0340f48/users/0be916c72ff74f5eb43cff4247046d41/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.347719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:32.353031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.376049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] RBAC: Authorizing `identity:create_grant(project_id=702d647ba7dc4c1ea9aad4f4b0340f48, user_id=0be916c72ff74f5eb43cff4247046d41, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:32.378888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:32.399466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c7ac-4cde-4705-ba19-f7b00b2b250f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:32.415365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 840/1703] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:32 2022] PUT /identity/v3/projects/702d647ba7dc4c1ea9aad4f4b0340f48/users/0be916c72ff74f5eb43cff4247046d41/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:32.416486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:32.554949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266e85f-5360-4d30-a4d8-9c23d694565e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:32.571949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:32.573110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.573225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.573448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] PATH_INFO: `/v3/projects/be7db2dbcfa448b2a3a58da7df6d638d/users/d988e09779544b92afae8f22244ba860/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.576584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5501d-51ac-44cc-b55f-ebb531759998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:32.577331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5501d-51ac-44cc-b55f-ebb531759998 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.577604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5501d-51ac-44cc-b55f-ebb531759998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.577871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5501d-51ac-44cc-b55f-ebb531759998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.612152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5501d-51ac-44cc-b55f-ebb531759998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:32.612152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5501d-51ac-44cc-b55f-ebb531759998 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:32.636970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7db2dbcfa448b2a3a58da7df6d638d, user_id=d988e09779544b92afae8f22244ba860, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:32.640375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:32.662501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 864/1704] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:32.665765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cab28-ebca-468e-aceb-146c6703f3c7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.666339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cab28-ebca-468e-aceb-146c6703f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.668428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cab28-ebca-468e-aceb-146c6703f3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.668580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 841/1705] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:32 2022] PUT /identity/v3/projects/be7db2dbcfa448b2a3a58da7df6d638d/users/d988e09779544b92afae8f22244ba860/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:32.669406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:32.676726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.736810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-053cab28-ebca-468e-aceb-146c6703f3c7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:32.738086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-053cab28-ebca-468e-aceb-146c6703f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:32.831511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97682-e704-43fa-ab3f-538979c6481c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:32.849511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:32.849511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:32.849511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:32.849913 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:32.877333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:32.879025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:32.897225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 842/1706] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:32.898381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:32.928362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:33.061099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113d10-a6b7-43e2-ac1f-a376ecd7da75 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:33.088310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45ec7-b252-4fb4-8bb2-fa38a321b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:33.089018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45ec7-b252-4fb4-8bb2-fa38a321b4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.089454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45ec7-b252-4fb4-8bb2-fa38a321b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.089930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45ec7-b252-4fb4-8bb2-fa38a321b4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.090838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45ec7-b252-4fb4-8bb2-fa38a321b4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:33.092995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45ec7-b252-4fb4-8bb2-fa38a321b4a7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:33.116610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 865/1707] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:33.120353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 843/1708] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:33.122074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.127497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.127991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.138364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.139654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.140375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.185077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] MFA Rules not processed for user `27677feb06384469994cf5706f482e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:33.186751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:33.202259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:33.215924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:33.231996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 866/1709] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:33.231996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:33.241830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:33.260868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f2b95-2a54-4ba2-b8f2-5be8dde4c7e4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:33.270312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:33.272180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.272570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.272978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] PATH_INFO: `/v3/projects/702d647ba7dc4c1ea9aad4f4b0340f48/users/0be916c72ff74f5eb43cff4247046d41/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.276186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702d647ba7dc4c1ea9aad4f4b0340f48, user_id=0be916c72ff74f5eb43cff4247046d41, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:33.279784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:33.314393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 867/1710] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:33 2022] PUT /identity/v3/projects/702d647ba7dc4c1ea9aad4f4b0340f48/users/0be916c72ff74f5eb43cff4247046d41/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:33.314393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:33.349600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 844/1711] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:33.351209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:33.368202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67be24-0c04-498a-87e7-48141622b1fa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:33.482640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6513322-f126-4dde-a66b-097c0e79f692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:33.483696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6513322-f126-4dde-a66b-097c0e79f692 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.484135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6513322-f126-4dde-a66b-097c0e79f692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.484543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6513322-f126-4dde-a66b-097c0e79f692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.512597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6513322-f126-4dde-a66b-097c0e79f692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:33.514674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6513322-f126-4dde-a66b-097c0e79f692 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:33.524260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd72e75-9664-42e3-a86b-69d929f51a94 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:33.537766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 845/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:33.543694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.545078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:33.546710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.547795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.548287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.549046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.549483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.553644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:33.554223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:33.559637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:33.578680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 868/1713] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:33.580021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:33.583097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:33.611518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] MFA Rules not processed for user `0be916c72ff74f5eb43cff4247046d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:33.613594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:33.673404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:33.773748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad03f72-c3f5-428a-bca5-10b0167def8e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:33.777665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 846/1714] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:33.790894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:33.794740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:33.801721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:33.802804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.803993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.804557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.811988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab5077-180a-450a-9887-52f1d40028f2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:33.830110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:33.831156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:33.831500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:33.846201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] PATH_INFO: `/v3/projects/d28a8a10e6664ef3b19077ee599cc3f7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:33.849185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28a8a10e6664ef3b19077ee599cc3f7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:33.854414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:33.974952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28a8a10e6664ef3b19077ee599cc3f7', 'request_id': 'req-cccc6344-3a3d-48a4-b87d-e38aa73da2df'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:33.987545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:33.988016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28a8a10e6664ef3b19077ee599cc3f7', 'request_id': 'req-cccc6344-3a3d-48a4-b87d-e38aa73da2df'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:33.989586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.002982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28a8a10e6664ef3b19077ee599cc3f7', 'request_id': 'req-cccc6344-3a3d-48a4-b87d-e38aa73da2df'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.019249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 869/1715] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:34.020702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:34.023837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] The token cache is being invalidate because project d28a8a10e6664ef3b19077ee599cc3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:34.024152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.025453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.027986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 847/1716] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:33 2022] DELETE /identity/v3/projects/d28a8a10e6664ef3b19077ee599cc3f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:34.029105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:34.031032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.049230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc9c9-61fd-47d1-a6cc-8c3689dc508b service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:34.097384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:34.130596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6344-3a3d-48a4-b87d-e38aa73da2df admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:34.135123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:34.157074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.159623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.160601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.167632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.228950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:34.230620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.231787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.232350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.233300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:34.249012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.306624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 870/1717] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:34 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:34.309593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:34.313557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.313719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:34.315699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.322195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:34.329605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 848/1718] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:34.332373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:34.336681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.355742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5f1b6-074f-40ae-842a-1cd8374aef73 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:34.478317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae666d-76ba-413c-8f3a-b451af923f00 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:34.494985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:34.494985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.494985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.494985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] PATH_INFO: `/v3/users/617b6d211d884b5d9dfe5d35b26a6379` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.497098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617b6d211d884b5d9dfe5d35b26a6379)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:34.499167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.526446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d4a4d-00aa-4c42-b58c-3dac45b63ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:34.528194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d4a4d-00aa-4c42-b58c-3dac45b63ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.528482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d4a4d-00aa-4c42-b58c-3dac45b63ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.528842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d4a4d-00aa-4c42-b58c-3dac45b63ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.530028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d4a4d-00aa-4c42-b58c-3dac45b63ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:34.532395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d4a4d-00aa-4c42-b58c-3dac45b63ab8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.578379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 849/1719] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:34 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:34.581417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd2bf-113a-4fb4-a8a1-802192e5e331 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.581766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd2bf-113a-4fb4-a8a1-802192e5e331 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.582101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd2bf-113a-4fb4-a8a1-802192e5e331 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.584578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 850/1720] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jul 21 22:38:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:34.586192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdd2bf-113a-4fb4-a8a1-802192e5e331 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:34.648669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617b6d211d884b5d9dfe5d35b26a6379'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.665809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdd2bf-113a-4fb4-a8a1-802192e5e331 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:34.668019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617b6d211d884b5d9dfe5d35b26a6379'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.669445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617b6d211d884b5d9dfe5d35b26a6379'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.669593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:34.670563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.671268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.671545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.673502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.689365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617b6d211d884b5d9dfe5d35b26a6379'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.690724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617b6d211d884b5d9dfe5d35b26a6379'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:34.736072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 871/1721] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:34 2022] DELETE /identity/v3/users/617b6d211d884b5d9dfe5d35b26a6379 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:34.741073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:34.750410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.822334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:34.830285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:34.832950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134bb21-7678-45ad-9b3c-ae275b0b0e8d service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.889903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 851/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:34.891399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.891969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.892270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.929393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca649dae-2d26-4ff2-a06c-1101edb411c7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:34.947585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:34.948296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:34.948666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:34.948850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:34.949609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:34.951440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:34.960340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:34.961797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:34.985404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 872/1723] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:34.985768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:35.007732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19a01b-6968-400a-a453-d40a35720d7f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:35.022721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:35.023461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:35.023741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:35.024013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:35.025153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:35.026483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:35.076615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 873/1724] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:35.077821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:35.098948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6995b00-bc26-4ead-af3a-3ac774952e21 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:35.111913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab945ad6-670e-45db-bc69-876b44ca0f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:35.112860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab945ad6-670e-45db-bc69-876b44ca0f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:35.113142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab945ad6-670e-45db-bc69-876b44ca0f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:35.113412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab945ad6-670e-45db-bc69-876b44ca0f11 admin admin] PATH_INFO: `/v3/projects/88fa4fea485c4f55b9cf99fd544eba35/users/db219714dff24fa4b43bafe377efe442/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:35.120526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:35.145253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab945ad6-670e-45db-bc69-876b44ca0f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fa4fea485c4f55b9cf99fd544eba35, user_id=db219714dff24fa4b43bafe377efe442, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:35.153246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab945ad6-670e-45db-bc69-876b44ca0f11 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:35.191648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 852/1725] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jul 21 22:38:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:35.206930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 874/1726] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:35 2022] PUT /identity/v3/projects/88fa4fea485c4f55b9cf99fd544eba35/users/db219714dff24fa4b43bafe377efe442/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:35.214838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:35.214838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:35.215130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:35.215493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:35.245795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb86091-5f7a-4c2f-874f-716ce762d485 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:35.292292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] MFA Rules not processed for user `db219714dff24fa4b43bafe377efe442`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:35.296320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:35.500729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:35.502196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:35.505443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:35.505994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:35.512842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:35.521127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 875/1727] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:35.542684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:35.544293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:35.571826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:35.576056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:35.606815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 853/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:35.733432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942843d-6a30-4b50-98ed-b4d3784dec9c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:35.740196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:35.742147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:35.756138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3e0c4-d7dd-4d60-b96a-8bd0703866df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:35.768389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3e0c4-d7dd-4d60-b96a-8bd0703866df service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:35.768389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3e0c4-d7dd-4d60-b96a-8bd0703866df service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:35.768389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3e0c4-d7dd-4d60-b96a-8bd0703866df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:35.780874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3e0c4-d7dd-4d60-b96a-8bd0703866df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:35.782049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3e0c4-d7dd-4d60-b96a-8bd0703866df service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:35.806957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 876/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:35.903073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b584e3f-8d05-4b38-b398-91bc6e691fdf service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:35.927350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:35.928240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:35.928520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:35.928792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] PATH_INFO: `/v3/projects/299217d78d4d4a9ea015d5828e3c006b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:35.931431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299217d78d4d4a9ea015d5828e3c006b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:35.934535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:36.035769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299217d78d4d4a9ea015d5828e3c006b', 'request_id': 'req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:36.048431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299217d78d4d4a9ea015d5828e3c006b', 'request_id': 'req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:36.062534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299217d78d4d4a9ea015d5828e3c006b', 'request_id': 'req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:36.094897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:36.101863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] The token cache is being invalidate because project 299217d78d4d4a9ea015d5828e3c006b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:36.107086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:36.109091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a2dfd0e3-6b43-4209-b0b4-cd2ef0f45f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:36.115029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 854/1730] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:35 2022] DELETE /identity/v3/projects/299217d78d4d4a9ea015d5828e3c006b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:38:36.117275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.118590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.119100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.150678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:36.152717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:36.181350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:36.302176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 877/1731] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:36.307369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.308028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.308527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.333665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:36.335728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:36.347815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 855/1732] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:36.351970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:36.364938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6960c-fad5-45ac-ae9d-f377fad4c681 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:36.376726 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:36.378218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.378218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.378721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.379976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:36.380291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:36.382130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:36.420256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:36.430540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 878/1733] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:38:36.432809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2d1e5-9d21-448f-89eb-a2984cc43e28 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:36.451899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1fdc1-ea71-4a11-be70-2af1dd4a8c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:36.452603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fdc1-ea71-4a11-be70-2af1dd4a8c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.452884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fdc1-ea71-4a11-be70-2af1dd4a8c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.453153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fdc1-ea71-4a11-be70-2af1dd4a8c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.453868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fdc1-ea71-4a11-be70-2af1dd4a8c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:36.455917 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fdc1-ea71-4a11-be70-2af1dd4a8c3a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:36.542213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:36.543250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 856/1734] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:36 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:36.555089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe725cd-8326-4386-8390-ee650e7bdf0f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:36.620675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37177fe5-47b3-47a1-b770-b0bb7ff59125 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.624451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37177fe5-47b3-47a1-b770-b0bb7ff59125 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.624732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37177fe5-47b3-47a1-b770-b0bb7ff59125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.697830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-37177fe5-47b3-47a1-b770-b0bb7ff59125 None None] MFA Rules not processed for user `71faa4cc60f74a089fdf763ba13f56fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:36.704024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-37177fe5-47b3-47a1-b770-b0bb7ff59125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:36.719897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:36.723511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.724888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.725299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.732531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:36.736808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:36.788233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 879/1735] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:36 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:36.790706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:36.829656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f73a6c-ec26-4eea-ba13-265182227ef8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:36.845071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:36.846967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.847927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.850083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.852174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:36.856710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:36.893080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 880/1736] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:36.896267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:36.935831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 857/1737] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:36.950179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.950672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.951240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.959058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0d201-44b5-473d-bdaa-47a55976f4f3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:36.977944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:36.980165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:36.981604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:36.982816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:36.983266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:36.988512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:37.007489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] MFA Rules not processed for user `71faa4cc60f74a089fdf763ba13f56fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:37.010307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:37.034576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 881/1738] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:37.039093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:37.046654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 858/1739] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:37.060227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:37.067965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:37.089557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06cd9-1505-40d3-9dce-74ae49ea4c3c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:37.122493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542748-fd0e-4f5c-9b84-8eb0dfe01589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:37.126233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542748-fd0e-4f5c-9b84-8eb0dfe01589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:37.126581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542748-fd0e-4f5c-9b84-8eb0dfe01589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:37.127254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542748-fd0e-4f5c-9b84-8eb0dfe01589 admin admin] PATH_INFO: `/v3/projects/15410713726645d1927cd913b2e00f6b/users/92702ba0a9b747609b2d4c4e2ae8c5e0/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:37.193024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df542748-fd0e-4f5c-9b84-8eb0dfe01589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15410713726645d1927cd913b2e00f6b, user_id=92702ba0a9b747609b2d4c4e2ae8c5e0, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:37.208907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df542748-fd0e-4f5c-9b84-8eb0dfe01589 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:37.259290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 882/1740] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:37 2022] PUT /identity/v3/projects/15410713726645d1927cd913b2e00f6b/users/92702ba0a9b747609b2d4c4e2ae8c5e0/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:37.271147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9c398-7bd9-4a5d-82a0-96bf142be1bc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:37.271147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9c398-7bd9-4a5d-82a0-96bf142be1bc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:37.271147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9c398-7bd9-4a5d-82a0-96bf142be1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:37.348134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c4d48-e7f4-4506-a23d-e4c7841937e1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:37.424493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1ab9c398-7bd9-4a5d-82a0-96bf142be1bc None None] MFA Rules not processed for user `92702ba0a9b747609b2d4c4e2ae8c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:37.429273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1ab9c398-7bd9-4a5d-82a0-96bf142be1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:37.495794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:37.547378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:37.553608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:37.559716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:37.560201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:37.570417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:37.600096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 883/1741] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:37.600096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:37.600096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:37.600096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:37.672330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] MFA Rules not processed for user `d988e09779544b92afae8f22244ba860`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:37.675135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:37.762912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:37.766263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:37.831021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 859/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:37.832050 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:37.881321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 884/1743] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:37.887130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:37.888917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:37.997808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78821ba4-90a8-40c7-aa3c-6db946f7ed0d service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.011354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.013889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.014183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.014538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.023727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.026313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.096495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 860/1744] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:37 2022] POST /identity/v3/projects => generated 363 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:38.102946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.159302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8666-93f5-4fb1-bf00-df9b0d913dff None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.276895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.277898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.277987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.278295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.287312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.299881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.343388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:38.373457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 885/1745] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:37 2022] POST /identity/v3/projects => generated 403 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:38.375410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.396409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5378509-4da4-437c-9be0-980924f0ec6e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.459490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:38.643663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.649226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.650486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.651485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.652760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.664996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.665872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958699-045a-4e5b-a638-ccb5348b289d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.703007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.705830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.706125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.706414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.712229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.730479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.738615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 861/1746] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:38 2022] POST /identity/v3/users => generated 288 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:38.741463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.747445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:38.759316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 886/1747] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:38 2022] POST /identity/v3/users => generated 308 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:38.760376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.772107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5400-a959-4a89-93e9-2e13b9fbf4c7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.774505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c1976-1d98-4727-a660-6fb6a377cad6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.783823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.784664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.784954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.785357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.788206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.788371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.788478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.788478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.788478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] PATH_INFO: `/v3/users/a5ecb7d3d1304405b71f5a25e86e97e2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.788924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ecb7d3d1304405b71f5a25e86e97e2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.790887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.791086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.812006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 887/1748] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:38.815196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.846436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461326-9c98-489c-9355-66028ef58eea admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.862481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.863244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.863586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.863895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.864726 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.866852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.883435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 888/1749] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:38.883435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.892343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ecb7d3d1304405b71f5a25e86e97e2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:38.893441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0e6e-7b09-4609-b89c-be33ea08aaf4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:38.900385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:38.901616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:38.902025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:38.902450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] PATH_INFO: `/v3/projects/f07a0fc4a39d42a8a6109c4bb545fce3/users/9652de6440104e379011bd009c3af5c9/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:38.903046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ecb7d3d1304405b71f5a25e86e97e2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:38.904203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ecb7d3d1304405b71f5a25e86e97e2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:38.915113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ecb7d3d1304405b71f5a25e86e97e2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:38.925758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07a0fc4a39d42a8a6109c4bb545fce3, user_id=9652de6440104e379011bd009c3af5c9, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:38.929089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:38.944990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ecb7d3d1304405b71f5a25e86e97e2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:38.955795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 889/1750] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:38 2022] PUT /identity/v3/projects/f07a0fc4a39d42a8a6109c4bb545fce3/users/9652de6440104e379011bd009c3af5c9/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:38.955795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.966826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:38.976361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 862/1751] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:38 2022] DELETE /identity/v3/users/a5ecb7d3d1304405b71f5a25e86e97e2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:38.980552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:38.982157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.081856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c443201-4b1a-4243-bef8-b900c9e0bcb5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.089299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84724-d9fc-4cbd-a459-cbc6da6af0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.089435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84724-d9fc-4cbd-a459-cbc6da6af0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.089794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84724-d9fc-4cbd-a459-cbc6da6af0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.090183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84724-d9fc-4cbd-a459-cbc6da6af0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.091506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84724-d9fc-4cbd-a459-cbc6da6af0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.093607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c84724-d9fc-4cbd-a459-cbc6da6af0f6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.108841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 863/1752] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:39.108841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022e2a-a242-4018-b55f-84d0c8ac42fe None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.108841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022e2a-a242-4018-b55f-84d0c8ac42fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.108841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022e2a-a242-4018-b55f-84d0c8ac42fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.124702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9200e8-2c7b-4012-897b-1fa04166ee11 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.131310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.132208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.132484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.132752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] PATH_INFO: `/v3/projects/c582b120da4140d49476fdac6cb0eb39/users/58e26338d49f494ea8df1bd8a4ca069f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.134853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d0022e2a-a242-4018-b55f-84d0c8ac42fe None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:39.137186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d0022e2a-a242-4018-b55f-84d0c8ac42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.150628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 864/1753] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:39.159994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3c25-a72b-43cb-96fa-0ff81a58b365 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.160290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3c25-a72b-43cb-96fa-0ff81a58b365 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.160556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3c25-a72b-43cb-96fa-0ff81a58b365 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.169574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c582b120da4140d49476fdac6cb0eb39, user_id=58e26338d49f494ea8df1bd8a4ca069f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.172366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 865/1754] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 22:38:39 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:39.173317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e3c25-a72b-43cb-96fa-0ff81a58b365 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:39.174753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.192211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e3c25-a72b-43cb-96fa-0ff81a58b365 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.196925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 890/1755] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:38 2022] PUT /identity/v3/projects/c582b120da4140d49476fdac6cb0eb39/users/58e26338d49f494ea8df1bd8a4ca069f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:39.196925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:39.198387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.203946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:39.255114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:39.267263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b680f4-22ab-43cb-bced-57332f936af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.270025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b680f4-22ab-43cb-bced-57332f936af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.270486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b680f4-22ab-43cb-bced-57332f936af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.270833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b680f4-22ab-43cb-bced-57332f936af2 admin admin] PATH_INFO: `/v3/projects/f07a0fc4a39d42a8a6109c4bb545fce3/users/9652de6440104e379011bd009c3af5c9/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.285018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b680f4-22ab-43cb-bced-57332f936af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07a0fc4a39d42a8a6109c4bb545fce3, user_id=9652de6440104e379011bd009c3af5c9, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.288482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b680f4-22ab-43cb-bced-57332f936af2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.302014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 866/1756] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:39 2022] PUT /identity/v3/projects/f07a0fc4a39d42a8a6109c4bb545fce3/users/9652de6440104e379011bd009c3af5c9/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:39.304084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a87ac-23e8-40d9-b989-da2491bcaaef admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.304846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.305476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.306082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.377397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:39.386129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.400962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95093820-b24c-4e94-9a05-4308204d1457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.401637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093820-b24c-4e94-9a05-4308204d1457 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.402049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093820-b24c-4e94-9a05-4308204d1457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.402328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95093820-b24c-4e94-9a05-4308204d1457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.546062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 867/1757] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:39.553114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:39.570558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95093820-b24c-4e94-9a05-4308204d1457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.574537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95093820-b24c-4e94-9a05-4308204d1457 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.599352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 891/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:39.608214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.608499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.608780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.673306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] MFA Rules not processed for user `9652de6440104e379011bd009c3af5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:39.674719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.708337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b5a6-1244-4446-8964-4eff27af1e73 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.724720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.725941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.726892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.729458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.731827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.745720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.774053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 868/1759] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:39.775082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:39.778703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.795074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1bbf-0998-44b0-88ed-25c1ba717729 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.799839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec9594-5e45-4947-a60d-da164012e3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.800301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9594-5e45-4947-a60d-da164012e3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.800692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9594-5e45-4947-a60d-da164012e3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.800896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec9594-5e45-4947-a60d-da164012e3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.813139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec9594-5e45-4947-a60d-da164012e3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.814664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec9594-5e45-4947-a60d-da164012e3e3 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.841517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 869/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:39.841517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.841517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.841795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.891105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] MFA Rules not processed for user `27677feb06384469994cf5706f482e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:39.892700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:39.896181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 892/1761] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:39.896803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:39.931050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a63768-10cc-4665-bf8a-7b4e058dc4b0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:39.936924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9962e-598d-40a3-8d53-8500bf537136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:39.937972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9962e-598d-40a3-8d53-8500bf537136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.938360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9962e-598d-40a3-8d53-8500bf537136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.938722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9962e-598d-40a3-8d53-8500bf537136 admin admin] PATH_INFO: `/v3/projects/c582b120da4140d49476fdac6cb0eb39/users/58e26338d49f494ea8df1bd8a4ca069f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.940961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9962e-598d-40a3-8d53-8500bf537136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c582b120da4140d49476fdac6cb0eb39, user_id=58e26338d49f494ea8df1bd8a4ca069f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:39.945178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9962e-598d-40a3-8d53-8500bf537136 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:39.961045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 893/1762] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:39 2022] PUT /identity/v3/projects/c582b120da4140d49476fdac6cb0eb39/users/58e26338d49f494ea8df1bd8a4ca069f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:39.961045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:39.961045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:39.961045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:39.967334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:40.001589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:40.024328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:40.027992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:40.067901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 870/1763] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:40.075583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:40.078702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:40.205461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 894/1764] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:40.218526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ce0f-1456-4094-a1ea-a7a06aa1a113 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:40.349319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:40.350966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:40.375395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b241cc-2988-4960-8f2f-92750dc34324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:40.376495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b241cc-2988-4960-8f2f-92750dc34324 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:40.376953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b241cc-2988-4960-8f2f-92750dc34324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:40.377355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b241cc-2988-4960-8f2f-92750dc34324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:40.539472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b241cc-2988-4960-8f2f-92750dc34324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:40.542920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b241cc-2988-4960-8f2f-92750dc34324 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:40.568240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 871/1765] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:40.575662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d34d67-06af-45f5-b423-7dd55e80a72c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:40.584922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:40.585742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:40.586124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:40.586494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:40.606444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:40.608776 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:40.636581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 895/1766] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:38:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 22:38:40.818209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15494-d1b7-47b9-adc7-a056f80a5222 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:40.818753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15494-d1b7-47b9-adc7-a056f80a5222 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:40.819114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15494-d1b7-47b9-adc7-a056f80a5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:40.882119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-55c15494-d1b7-47b9-adc7-a056f80a5222 None None] MFA Rules not processed for user `71faa4cc60f74a089fdf763ba13f56fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:40.884448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-55c15494-d1b7-47b9-adc7-a056f80a5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:41.028416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:41.051186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 872/1767] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:41.459866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:41.571794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:41.611477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766292-ab33-414b-a33e-0ce341e88052 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:41.623419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:41.624595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:41.625023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:41.625857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] PATH_INFO: `/v3/users/92702ba0a9b747609b2d4c4e2ae8c5e0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:41.627563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92702ba0a9b747609b2d4c4e2ae8c5e0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:41.633328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:41.815084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92702ba0a9b747609b2d4c4e2ae8c5e0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:41.830794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92702ba0a9b747609b2d4c4e2ae8c5e0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:41.832251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92702ba0a9b747609b2d4c4e2ae8c5e0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:41.857471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92702ba0a9b747609b2d4c4e2ae8c5e0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:41.859189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92702ba0a9b747609b2d4c4e2ae8c5e0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:41.925488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 896/1768] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:41 2022] DELETE /identity/v3/users/92702ba0a9b747609b2d4c4e2ae8c5e0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:41.929768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:41.930309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:41.930379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:41.973868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:41.975124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:42.221551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 873/1769] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:42.249236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:42.254447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:42.468468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:42.470455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:42.532127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57a28-d472-4488-8dd4-2db0a9462f67 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:42.569820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:42.572331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:42.575462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:42.579062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] PATH_INFO: `/v3/projects/27f3da9af8f6445096952e1b37b1d3ca` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:42.586698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30210496-5974-4161-8e67-0eac6815df09 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:42.587867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f3da9af8f6445096952e1b37b1d3ca)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:42.597948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:42.604232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:42.607549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:42.608268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:42.608720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:42.643790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:42.647032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:42.707355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 897/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:38:42.790815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f3da9af8f6445096952e1b37b1d3ca', 'request_id': 'req-4df441ba-3699-4b20-b146-7ebed850f64a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:42.806680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f3da9af8f6445096952e1b37b1d3ca', 'request_id': 'req-4df441ba-3699-4b20-b146-7ebed850f64a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:42.818532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f3da9af8f6445096952e1b37b1d3ca', 'request_id': 'req-4df441ba-3699-4b20-b146-7ebed850f64a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:42.842739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] The token cache is being invalidate because project 27f3da9af8f6445096952e1b37b1d3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:42.843430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:42.848661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:42.851128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 874/1771] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:42 2022] DELETE /identity/v3/projects/27f3da9af8f6445096952e1b37b1d3ca => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:42.855521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:42.879736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca66ce-0c3a-47a6-a093-da6710452607 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:43.193170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:43.197844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:43.197844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:43.201078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] PATH_INFO: `/v3/users/0be916c72ff74f5eb43cff4247046d41` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:43.206291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be916c72ff74f5eb43cff4247046d41)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:43.219281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:43.274070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:43.444629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be916c72ff74f5eb43cff4247046d41'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:43.482719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be916c72ff74f5eb43cff4247046d41'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:43.486238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be916c72ff74f5eb43cff4247046d41'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:43.514601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be916c72ff74f5eb43cff4247046d41'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:43.517248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be916c72ff74f5eb43cff4247046d41'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:43.589355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 898/1772] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:42 2022] DELETE /identity/v3/users/0be916c72ff74f5eb43cff4247046d41 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:44.032878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:44.035294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:44.080824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df441ba-3699-4b20-b146-7ebed850f64a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:44.284492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:44.286424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:44.287300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:44.287788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] PATH_INFO: `/v3/projects/15410713726645d1927cd913b2e00f6b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:44.289681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15410713726645d1927cd913b2e00f6b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:44.292022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:44.336730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:44.415862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15410713726645d1927cd913b2e00f6b', 'request_id': 'req-27188e56-b4b8-47bb-b725-27e813001ed8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:44.423131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15410713726645d1927cd913b2e00f6b', 'request_id': 'req-27188e56-b4b8-47bb-b725-27e813001ed8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:44.432882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15410713726645d1927cd913b2e00f6b', 'request_id': 'req-27188e56-b4b8-47bb-b725-27e813001ed8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:44.455532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] The token cache is being invalidate because project 15410713726645d1927cd913b2e00f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:44.456493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:44.457502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-27188e56-b4b8-47bb-b725-27e813001ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:44.464908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 875/1773] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:44 2022] DELETE /identity/v3/projects/15410713726645d1927cd913b2e00f6b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:44.468997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:44.470540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:44.534443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aeebc-a10f-4fe4-b9f3-a55899b2b239 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:44.918334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:44.922544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:44.923752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:44.924896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] PATH_INFO: `/v3/users/9652de6440104e379011bd009c3af5c9` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:44.935772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9652de6440104e379011bd009c3af5c9)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:44.942310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:45.110973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9652de6440104e379011bd009c3af5c9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.140465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9652de6440104e379011bd009c3af5c9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.143591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9652de6440104e379011bd009c3af5c9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.160368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaf85f-5320-4231-8e67-7ac04f93de6b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:45.161530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaf85f-5320-4231-8e67-7ac04f93de6b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:45.162458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecaf85f-5320-4231-8e67-7ac04f93de6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:45.183243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9652de6440104e379011bd009c3af5c9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.186170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9652de6440104e379011bd009c3af5c9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.237871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6ecaf85f-5320-4231-8e67-7ac04f93de6b None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:45.248136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6ecaf85f-5320-4231-8e67-7ac04f93de6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:45.337862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 899/1774] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:44 2022] DELETE /identity/v3/users/9652de6440104e379011bd009c3af5c9 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:45.430642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:45.432476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:45.460906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:45.540716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 876/1775] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 22:38:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:38:45.635882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc419a-a824-41a1-a867-8bb27b7b0120 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:45.644781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:45.646418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:45.646840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:45.647295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] PATH_INFO: `/v3/users/d74a1ea477024402a7870c223c9a44c4` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:45.649043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74a1ea477024402a7870c223c9a44c4)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:45.651616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:45.757833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74a1ea477024402a7870c223c9a44c4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.780605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74a1ea477024402a7870c223c9a44c4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.781354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74a1ea477024402a7870c223c9a44c4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.802051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74a1ea477024402a7870c223c9a44c4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.803068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74a1ea477024402a7870c223c9a44c4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:45.858289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 900/1776] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:45 2022] DELETE /identity/v3/users/d74a1ea477024402a7870c223c9a44c4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:38:45.863518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbdab8-d1d3-49a2-bd4c-8e799108443b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:45.864047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbdab8-d1d3-49a2-bd4c-8e799108443b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:45.864650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbdab8-d1d3-49a2-bd4c-8e799108443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:45.896399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:45.900254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:45.932996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cbcbdab8-d1d3-49a2-bd4c-8e799108443b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:45.939657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cbcbdab8-d1d3-49a2-bd4c-8e799108443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:46.101325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e7acf-0ffb-4c86-b4b8-e05feb107604 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:46.116446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:46.116650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:46.116749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:46.119977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:46.126323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:46.144938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:46.146904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:46.158316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 901/1777] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:38:46.263975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 877/1778] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:46.365164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:46.395516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ad7f9-4dd0-44e3-8df9-d73655059baa service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:46.404151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:46.406771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:46.407167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:46.411063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:46.432787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:46.437004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:46.479990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 902/1779] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:48.081123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:48.082505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:48.083014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:48.149843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] MFA Rules not processed for user `58e26338d49f494ea8df1bd8a4ca069f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:48.156645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:48.268572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:48.270128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:48.300383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b220050-e66a-47dd-8335-1a8545e2e603 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:48.303660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:48.325173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:48.326003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:48.326287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:48.326604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] PATH_INFO: `/v3/projects/df118f16df4548f0808ed9e0c65bdd3a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:48.329238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df118f16df4548f0808ed9e0c65bdd3a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:48.332858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:48.384953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 878/1780] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:48.391872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:48.508905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df118f16df4548f0808ed9e0c65bdd3a', 'request_id': 'req-5e8acdca-3362-4f17-bb69-141e224fd130'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.523672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df118f16df4548f0808ed9e0c65bdd3a', 'request_id': 'req-5e8acdca-3362-4f17-bb69-141e224fd130'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.539940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df118f16df4548f0808ed9e0c65bdd3a', 'request_id': 'req-5e8acdca-3362-4f17-bb69-141e224fd130'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.567729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] The token cache is being invalidate because project df118f16df4548f0808ed9e0c65bdd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:48.568088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.568741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.578554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 903/1781] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:48 2022] DELETE /identity/v3/projects/df118f16df4548f0808ed9e0c65bdd3a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:48.579763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:48.601928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f259f23-9ddd-4c3c-b5ac-361bc65810ee None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:48.754412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:48.755539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:48.755919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:48.756385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] PATH_INFO: `/v3/users/040d2a37063a42bc908b39d528c621b1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:48.758773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040d2a37063a42bc908b39d528c621b1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:48.770774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:48.895990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040d2a37063a42bc908b39d528c621b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.927588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040d2a37063a42bc908b39d528c621b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.928769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040d2a37063a42bc908b39d528c621b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.944319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040d2a37063a42bc908b39d528c621b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.972181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-35a87ebe-9cce-4237-9699-458279dbd242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040d2a37063a42bc908b39d528c621b1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:48.996876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 879/1782] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:48 2022] DELETE /identity/v3/users/040d2a37063a42bc908b39d528c621b1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:38:50.077337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:50.079154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:50.117424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8acdca-3362-4f17-bb69-141e224fd130 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:50.308185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:50.312270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:50.312810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:50.313258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] PATH_INFO: `/v3/projects/702d647ba7dc4c1ea9aad4f4b0340f48` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:50.319843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702d647ba7dc4c1ea9aad4f4b0340f48)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:50.324037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:50.485700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702d647ba7dc4c1ea9aad4f4b0340f48', 'request_id': 'req-0488690d-22ef-4fcb-93ca-26aabece7d83'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:50.500474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702d647ba7dc4c1ea9aad4f4b0340f48', 'request_id': 'req-0488690d-22ef-4fcb-93ca-26aabece7d83'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:50.517315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702d647ba7dc4c1ea9aad4f4b0340f48', 'request_id': 'req-0488690d-22ef-4fcb-93ca-26aabece7d83'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:50.543468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] The token cache is being invalidate because project 702d647ba7dc4c1ea9aad4f4b0340f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:50.543898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:50.545144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0488690d-22ef-4fcb-93ca-26aabece7d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:50.548237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 904/1783] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:50 2022] DELETE /identity/v3/projects/702d647ba7dc4c1ea9aad4f4b0340f48 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:50.554588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:50.555127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:50.555498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:50.592617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:50.594110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:50.807610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 880/1784] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:50.809841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:50.810414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:50.810944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:50.867453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:50.873578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:50.913173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 905/1785] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:38:50.916328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:50.923489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:50.938341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f05141-9c51-411b-826c-36bf9d839430 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:50.953029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:50.953724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:50.954022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:50.954322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:50.956560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:50.956560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:50.977272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.014083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 881/1786] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:51.018877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.038192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336508f-38d7-4c29-912b-de50488e1bfd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:51.060476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:51.062500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.062903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.064044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.068961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:51.072583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.126018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:51.147776 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 906/1787] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:51 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:51.149217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.166056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659b2e-3d48-4389-a538-b4e42a2b3dbb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:51.331800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:51.346047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.346594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.350453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.351507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:51.356559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.427363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 882/1788] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:51 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:51.431240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.457810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be33b4-b096-4a0b-bc05-6614a9dc5628 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:51.474406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:51.475962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.488258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.488757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.492267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:51.494125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.496553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:51.517109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.546543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813279-ffea-4ecc-a4ea-591869baf655 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:51.562168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:51.564979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.565803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.566541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] PATH_INFO: `/v3/users/db219714dff24fa4b43bafe377efe442` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.569556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db219714dff24fa4b43bafe377efe442)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:51.572731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 907/1789] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:51.573733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.573879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.597152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d4d87-6ba9-475b-94dc-91b6669d5959 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:51.605680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:51.606695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.607181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.607598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.609037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:51.626838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.666732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 908/1790] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:51.668059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.698719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e768a-edc0-42bd-b510-0cbd31288024 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:51.708221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a284a-754a-4648-80a6-717e5fbe5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:51.709591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a284a-754a-4648-80a6-717e5fbe5a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.710247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a284a-754a-4648-80a6-717e5fbe5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.710715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a284a-754a-4648-80a6-717e5fbe5a5f admin admin] PATH_INFO: `/v3/projects/21bed6bd7b0b419aa0b130fee7f2cd72/users/7178c6510fa849dfade18b01ea7b5a12/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.716586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db219714dff24fa4b43bafe377efe442'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:51.736367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a284a-754a-4648-80a6-717e5fbe5a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bed6bd7b0b419aa0b130fee7f2cd72, user_id=7178c6510fa849dfade18b01ea7b5a12, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:51.739330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a284a-754a-4648-80a6-717e5fbe5a5f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:51.743805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db219714dff24fa4b43bafe377efe442'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:51.745622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db219714dff24fa4b43bafe377efe442'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:51.760269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db219714dff24fa4b43bafe377efe442'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:51.774461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9dc35bdc-7c19-4ffa-824c-4d9558554b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db219714dff24fa4b43bafe377efe442'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:51.783103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 909/1791] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:51 2022] PUT /identity/v3/projects/21bed6bd7b0b419aa0b130fee7f2cd72/users/7178c6510fa849dfade18b01ea7b5a12/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:51.785519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.786058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.786474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.793914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 883/1792] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:51 2022] DELETE /identity/v3/users/db219714dff24fa4b43bafe377efe442 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:38:51.800851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:51.802345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:51.803325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:51.843088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:51.846743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:51.855719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] MFA Rules not processed for user `7178c6510fa849dfade18b01ea7b5a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:51.856970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:51.977880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 910/1793] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:51.984136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:51.987305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:51.991295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.025011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 884/1794] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:52.119815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66ce3-84ea-49fc-9dc0-caa16bd39806 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:52.128156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:52.129654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.130053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.130438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.131303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:52.134419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:52.154021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:52.155779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:52.181992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 911/1795] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:51 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:52.184135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:52.317137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.355179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167196f-49eb-4313-b880-b5447bfd5101 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:52.417192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e318a-9bc3-4114-ace9-6d1e9be8182b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:52.431802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:52.432688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.432972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.433363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.434294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:52.437584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:52.487339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 912/1796] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:52 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:38:52.488189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:52.493697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:52.513041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:52.514401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.514837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.515291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.520043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871f813-5241-44b7-ae66-17f33b617073 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:52.526064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:52.527888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.528214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.529757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] PATH_INFO: `/v3/projects/5d9700a882fc46b6a4839946c101bd0a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.531700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9700a882fc46b6a4839946c101bd0a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:52.534489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:52.546302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:52.546302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:52.566347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 885/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:52.567439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:52.593907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb280e-7f62-4cb1-992a-bde188e16936 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:52.601726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4639a1-56d8-445c-81d7-0ebd2bacc875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:52.602444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4639a1-56d8-445c-81d7-0ebd2bacc875 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.602768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4639a1-56d8-445c-81d7-0ebd2bacc875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.603204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4639a1-56d8-445c-81d7-0ebd2bacc875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.603963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4639a1-56d8-445c-81d7-0ebd2bacc875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:52.605858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4639a1-56d8-445c-81d7-0ebd2bacc875 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:52.639954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 886/1798] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:52.641638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002322cd-4a7f-4755-99a5-c11052dc0ed8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.642070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002322cd-4a7f-4755-99a5-c11052dc0ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.642070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002322cd-4a7f-4755-99a5-c11052dc0ed8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.644064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 887/1799] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:52.644781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002322cd-4a7f-4755-99a5-c11052dc0ed8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:52.677578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002322cd-4a7f-4755-99a5-c11052dc0ed8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:52.735302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9700a882fc46b6a4839946c101bd0a', 'request_id': 'req-6a165699-3dde-4ff8-8a22-1762121095cd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:52.746217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9700a882fc46b6a4839946c101bd0a', 'request_id': 'req-6a165699-3dde-4ff8-8a22-1762121095cd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:52.764595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9700a882fc46b6a4839946c101bd0a', 'request_id': 'req-6a165699-3dde-4ff8-8a22-1762121095cd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:52.780392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] The token cache is being invalidate because project 5d9700a882fc46b6a4839946c101bd0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:52.780823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:52.781693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6a165699-3dde-4ff8-8a22-1762121095cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:52.784211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 913/1800] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:52 2022] DELETE /identity/v3/projects/5d9700a882fc46b6a4839946c101bd0a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:52.791592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d144-c0b5-4882-92db-743439a16577 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.791913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d144-c0b5-4882-92db-743439a16577 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.792099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d144-c0b5-4882-92db-743439a16577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.814519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8bc8d144-c0b5-4882-92db-743439a16577 None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:52.816389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8bc8d144-c0b5-4882-92db-743439a16577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:52.863478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:52.865107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.865636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.866116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] PATH_INFO: `/v3/projects/581329d876b64b27a0c9b23eeb944a5d/users/fc42c844ab01492ea74a1fbbca5f70a4/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.889906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=581329d876b64b27a0c9b23eeb944a5d, user_id=fc42c844ab01492ea74a1fbbca5f70a4, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:52.893214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:52.911546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 914/1801] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:52.913163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd518d-9dd1-47ad-82da-589ab6b6fbf5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:52.913461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd518d-9dd1-47ad-82da-589ab6b6fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:52.913806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd518d-9dd1-47ad-82da-589ab6b6fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:52.920566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 888/1802] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:52 2022] PUT /identity/v3/projects/581329d876b64b27a0c9b23eeb944a5d/users/fc42c844ab01492ea74a1fbbca5f70a4/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:52.922306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:52.927358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:52.936321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-75fd518d-9dd1-47ad-82da-589ab6b6fbf5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:52.937702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-75fd518d-9dd1-47ad-82da-589ab6b6fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:52.991611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:53.017938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:53.084911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 915/1803] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:53.087734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.088024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.088396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.120785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:53.122799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:53.151734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a060-93b4-440f-8b5c-20ca552ab50d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:53.162876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 916/1804] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:53.169450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:53.173997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:53.176678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:53.179413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.180030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.181872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.187066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:53.196941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:53.237133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 889/1805] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:53.240296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:53.265001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a67a-1a98-4a52-8242-b5ef3670537d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:53.277632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:53.280726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.281175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.282108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.282700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:53.296313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:53.301112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58599d54-1cc9-4284-9c97-f3ec232e72a1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:53.345473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 890/1806] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:53.346943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72d743-6ce5-4472-8aac-c9d4ebb34b6b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.347198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72d743-6ce5-4472-8aac-c9d4ebb34b6b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.347474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72d743-6ce5-4472-8aac-c9d4ebb34b6b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.353046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 891/1807] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:38:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:53.353959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72d743-6ce5-4472-8aac-c9d4ebb34b6b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:53.363615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb72d743-6ce5-4472-8aac-c9d4ebb34b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:53.421233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72d743-6ce5-4472-8aac-c9d4ebb34b6b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:53.422528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f2338-530e-4a2a-9e07-473e204adf63 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:53.432042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:53.434193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.435075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:53.436056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.436526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.436980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] PATH_INFO: `/v3/projects/f07a0fc4a39d42a8a6109c4bb545fce3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.438077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.438490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.439345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07a0fc4a39d42a8a6109c4bb545fce3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:53.446159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:53.463619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:53.465823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:53.506447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 917/1808] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:53.507637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:53.527269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4929278-911b-482d-9a02-4d58a324490a service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:53.546748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:53.548902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.551261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.551554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] PATH_INFO: `/v3/projects/581329d876b64b27a0c9b23eeb944a5d/users/fc42c844ab01492ea74a1fbbca5f70a4/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.557549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581329d876b64b27a0c9b23eeb944a5d, user_id=fc42c844ab01492ea74a1fbbca5f70a4, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:53.565692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:53.573034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07a0fc4a39d42a8a6109c4bb545fce3', 'request_id': 'req-4a279162-7471-4bbc-94bb-09bd64bc2c03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:53.595297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07a0fc4a39d42a8a6109c4bb545fce3', 'request_id': 'req-4a279162-7471-4bbc-94bb-09bd64bc2c03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:53.605082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 918/1809] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:53 2022] PUT /identity/v3/projects/581329d876b64b27a0c9b23eeb944a5d/users/fc42c844ab01492ea74a1fbbca5f70a4/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:53.608098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:53.624061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07a0fc4a39d42a8a6109c4bb545fce3', 'request_id': 'req-4a279162-7471-4bbc-94bb-09bd64bc2c03'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:53.643299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] The token cache is being invalidate because project f07a0fc4a39d42a8a6109c4bb545fce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:53.643619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:53.644284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4a279162-7471-4bbc-94bb-09bd64bc2c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:53.646685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 892/1810] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:53 2022] DELETE /identity/v3/projects/f07a0fc4a39d42a8a6109c4bb545fce3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:53.649551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5977f7-2256-413e-9d75-0a352024959a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.649835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5977f7-2256-413e-9d75-0a352024959a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.650303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5977f7-2256-413e-9d75-0a352024959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.693252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ac5977f7-2256-413e-9d75-0a352024959a None None] MFA Rules not processed for user `fc42c844ab01492ea74a1fbbca5f70a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:53.694699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ac5977f7-2256-413e-9d75-0a352024959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:53.824121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54259991-2d46-40d3-bdc4-76c4c37057b8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:53.837705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6f77f-41c7-485c-89af-c6bcc7b736c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:53.838410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6f77f-41c7-485c-89af-c6bcc7b736c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.838693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6f77f-41c7-485c-89af-c6bcc7b736c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.838971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6f77f-41c7-485c-89af-c6bcc7b736c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.839788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6f77f-41c7-485c-89af-c6bcc7b736c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:53.843674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6f77f-41c7-485c-89af-c6bcc7b736c5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:53.871069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 893/1811] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:53.872808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.873341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.873823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.900035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 919/1812] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:53 2022] POST /identity/v3/projects => generated 367 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:53.904583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:53.904877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:53.905153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:53.912927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:53.914743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:53.937606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:53.948713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:53.949980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.060394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.096860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 894/1813] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:54.097988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.100883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.233256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 920/1814] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:54.239987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076873-aff2-4b7f-b5c4-8a77eabeadae None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.241211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.241211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.260752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.261707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.262092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.262446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.282723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc5e7-b89f-42bb-87ec-8e74b286bb1b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.296238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d48da-4af4-402a-8877-16a1f5dffafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.296957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d48da-4af4-402a-8877-16a1f5dffafb admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.297243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d48da-4af4-402a-8877-16a1f5dffafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.299134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d48da-4af4-402a-8877-16a1f5dffafb admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.301189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d48da-4af4-402a-8877-16a1f5dffafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.312114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d48da-4af4-402a-8877-16a1f5dffafb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.364948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 921/1815] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:54 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:54.366865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.367408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.368014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.415102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:54.416568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.426697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 922/1816] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:54.427852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.443586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab22fc-5df3-40a3-a5c8-5df3273bd10c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.450336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.452595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.452947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.453436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.454298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.456293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.456764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.458782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.471774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 923/1817] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:54.472920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.477310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 895/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:54.478607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.506175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285741b9-1e88-4e58-91a1-b024634315b1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.517521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ee9b-f2f8-4863-b986-ed4f144270a9 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.518560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.519393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.519749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.520096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.521108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:54.522740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.524954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.529135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.530086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.530764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.531609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.532664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.534790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.541968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 924/1819] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:54.546439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.558755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 896/1820] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:54.562982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.568426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac08bd-2b6b-4d2b-9755-db2e30a11513 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.580697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.581881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ffab-21b3-43b1-b371-f0bd27329f10 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.582389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.582389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.585667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.587134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.589161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.597799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.598801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.599229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.599874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] PATH_INFO: `/v3/projects/8f0112a97f1d429fba5a1916c9c7096d/users/075e25e6dcf34de493528c1a906c49b2/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.632915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0112a97f1d429fba5a1916c9c7096d, user_id=075e25e6dcf34de493528c1a906c49b2, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.640205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.661375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 925/1821] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:54 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:54.661375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.661375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.680786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 897/1822] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:54 2022] PUT /identity/v3/projects/8f0112a97f1d429fba5a1916c9c7096d/users/075e25e6dcf34de493528c1a906c49b2/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:54.682078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.734413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.762632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d839b-5697-4fbe-9c28-561f37900750 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.769428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6ce3-98e8-439c-b459-0cef5ae4eb8c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.769771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.770801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.771286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.771761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.774264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.893281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.918726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.922498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.939214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f6a23-c384-4cd3-be78-4a28ccaba27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.940327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6a23-c384-4cd3-be78-4a28ccaba27a service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.940600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6a23-c384-4cd3-be78-4a28ccaba27a service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.940888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f6a23-c384-4cd3-be78-4a28ccaba27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.949899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 898/1823] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:54.950801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.969317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f6a23-c384-4cd3-be78-4a28ccaba27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.973473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f6a23-c384-4cd3-be78-4a28ccaba27a service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.023891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 926/1824] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:55.025676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653903-c041-43a6-9462-8437267a1137 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.025970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653903-c041-43a6-9462-8437267a1137 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.026252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653903-c041-43a6-9462-8437267a1137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.066374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d4653903-c041-43a6-9462-8437267a1137 None None] MFA Rules not processed for user `075e25e6dcf34de493528c1a906c49b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:55.069642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d4653903-c041-43a6-9462-8437267a1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:55.143802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18fe3e-69f1-4235-bc3c-7b72791877a7 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.165111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.165827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.166112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.166489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.167117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.185675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.238915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 899/1825] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:54 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:55.242817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.268453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaf7dd-fae4-423b-af02-c7b94aff4233 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.280524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 927/1826] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:55.281824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4653903-c041-43a6-9462-8437267a1137 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.283846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.284618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d4653903-c041-43a6-9462-8437267a1137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:55.287270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.288311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.288779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.289713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.294425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.302504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4653903-c041-43a6-9462-8437267a1137 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.309936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.312356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.312640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.312973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] PATH_INFO: `/v3/users/d988e09779544b92afae8f22244ba860` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.317279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d988e09779544b92afae8f22244ba860)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.318103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.330218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 900/1827] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:55.331023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.350818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e30207-8f20-4891-9701-91d91f70954c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.356618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.359846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.359846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.359846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.359846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.361433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.409811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 901/1828] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:55 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:55.411169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.426736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd988e09779544b92afae8f22244ba860'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.440046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd988e09779544b92afae8f22244ba860'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.441769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd988e09779544b92afae8f22244ba860'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.459525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd988e09779544b92afae8f22244ba860'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.460338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd988e09779544b92afae8f22244ba860'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.492762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:55.497741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 928/1829] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:55 2022] DELETE /identity/v3/users/d988e09779544b92afae8f22244ba860 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:55.499168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.500353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:55.538441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80406360-bb45-4788-a179-6626efacd2ae admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.617209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:55.643442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50a909-fe01-462c-9252-8e1b53655f58 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.653933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.656133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.656956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.657610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.658736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.661833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.668067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.668849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.670384 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.670739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.672087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.675253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.683747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 902/1830] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:55.685182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.689922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:55.704930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e000b-ca0a-4a18-adc8-0789a8eb3101 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.716711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 929/1831] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:55 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:55.717601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.721323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.722325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.722504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.722781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] PATH_INFO: `/v3/users/7178c6510fa849dfade18b01ea7b5a12` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.723447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:55.727578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7178c6510fa849dfade18b01ea7b5a12)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.729855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.743415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822176-4251-4e21-9b12-b24c166e8aff admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.751499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.751499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.752346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.752634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] PATH_INFO: `/v3/projects/df0396d86c55491fb172b23970f4bb58/users/2d957f4b57044932afea07e527ab19f4/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.775808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0396d86c55491fb172b23970f4bb58, user_id=2d957f4b57044932afea07e527ab19f4, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.779084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:55.796227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 930/1832] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:55 2022] PUT /identity/v3/projects/df0396d86c55491fb172b23970f4bb58/users/2d957f4b57044932afea07e527ab19f4/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:55.797322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.817081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7178c6510fa849dfade18b01ea7b5a12'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.828310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7178c6510fa849dfade18b01ea7b5a12'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.829499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7178c6510fa849dfade18b01ea7b5a12'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.840295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7178c6510fa849dfade18b01ea7b5a12'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.856861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b2d44fe4-683f-42d0-879b-c872eb24eef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7178c6510fa849dfade18b01ea7b5a12'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:55.865990 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 903/1833] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:55 2022] DELETE /identity/v3/users/7178c6510fa849dfade18b01ea7b5a12 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:55.867739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195f1b-a2d5-4dd8-af00-c8363f39fa20 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.868133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195f1b-a2d5-4dd8-af00-c8363f39fa20 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.868640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195f1b-a2d5-4dd8-af00-c8363f39fa20 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.870622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 904/1834] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:38:55.871628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195f1b-a2d5-4dd8-af00-c8363f39fa20 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:55.873797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be195f1b-a2d5-4dd8-af00-c8363f39fa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:55.882618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b061-c11e-4f68-99ee-1d88a43a5628 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.961509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:55.973149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195f1b-a2d5-4dd8-af00-c8363f39fa20 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:55.979072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:55.980555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:55.981204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:55.981597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] PATH_INFO: `/v3/projects/88fa4fea485c4f55b9cf99fd544eba35` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:55.983208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fa4fea485c4f55b9cf99fd544eba35)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:55.985748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.054497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fa4fea485c4f55b9cf99fd544eba35', 'request_id': 'req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.061561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fa4fea485c4f55b9cf99fd544eba35', 'request_id': 'req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.069246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed67326-94a9-4c72-9af9-8a349958cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.070314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67326-94a9-4c72-9af9-8a349958cc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.070874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67326-94a9-4c72-9af9-8a349958cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.071368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed67326-94a9-4c72-9af9-8a349958cc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.072629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67326-94a9-4c72-9af9-8a349958cc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.074532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fa4fea485c4f55b9cf99fd544eba35', 'request_id': 'req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.075008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed67326-94a9-4c72-9af9-8a349958cc08 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.087009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 931/1835] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:56.088707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc837d7-5e08-4426-94be-3609dfa93247 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.089197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc837d7-5e08-4426-94be-3609dfa93247 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.089639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc837d7-5e08-4426-94be-3609dfa93247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.092188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] The token cache is being invalidate because project 88fa4fea485c4f55b9cf99fd544eba35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:56.092587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.093604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbe6d6fc-0c07-45d3-aaf5-e229d3082555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.107328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 905/1836] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:55 2022] DELETE /identity/v3/projects/88fa4fea485c4f55b9cf99fd544eba35 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:56.109702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.110156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.110267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.137365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:56.139520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.169823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fdc837d7-5e08-4426-94be-3609dfa93247 None None] MFA Rules not processed for user `2d957f4b57044932afea07e527ab19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:56.172515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fdc837d7-5e08-4426-94be-3609dfa93247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.232611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:56.276403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 906/1837] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:56.277290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 932/1838] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:56.278801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.279446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.281802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.286919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.287460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.300401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e68e5-e29a-48e4-9d5b-146204bf8fcc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:56.307572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1448f6-c663-4a32-ac4d-6ba43124592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.308961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:56.309206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1448f6-c663-4a32-ac4d-6ba43124592a admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.309914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1448f6-c663-4a32-ac4d-6ba43124592a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.310432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1448f6-c663-4a32-ac4d-6ba43124592a admin admin] PATH_INFO: `/v3/projects/60e5f12f31734894af556e690f2c8998/users/b5e31731e52a4ba092dd0d6730898f76/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.320493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.353048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1448f6-c663-4a32-ac4d-6ba43124592a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e5f12f31734894af556e690f2c8998, user_id=b5e31731e52a4ba092dd0d6730898f76, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.357191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1448f6-c663-4a32-ac4d-6ba43124592a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.393165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 907/1839] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:56 2022] PUT /identity/v3/projects/60e5f12f31734894af556e690f2c8998/users/b5e31731e52a4ba092dd0d6730898f76/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:56.395395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.395839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.396284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.442335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:56.444468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.467736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 933/1840] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:56.468828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.470841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.488072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811ab5b-125c-4097-b903-db7c73f6b2a5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:56.541749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 908/1841] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:56.541749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.541749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.548528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:56.553508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594217ba-c023-4779-80b4-c1fa22dba161 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:56.561453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.562265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.562741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.563240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.564331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.567934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.592337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.594015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.595160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.595695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] PATH_INFO: `/v3/projects/be7db2dbcfa448b2a3a58da7df6d638d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.598043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7db2dbcfa448b2a3a58da7df6d638d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.599715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 909/1842] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:56.600833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.600950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.602664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.693869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4047df-2080-4d7a-b010-40292f831f37 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:56.705566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7db2dbcfa448b2a3a58da7df6d638d', 'request_id': 'req-c39c3397-d21a-47f2-85f4-0990ad3b6770'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.720979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7db2dbcfa448b2a3a58da7df6d638d', 'request_id': 'req-c39c3397-d21a-47f2-85f4-0990ad3b6770'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.733139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7db2dbcfa448b2a3a58da7df6d638d', 'request_id': 'req-c39c3397-d21a-47f2-85f4-0990ad3b6770'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.741871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:56.748368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] The token cache is being invalidate because project be7db2dbcfa448b2a3a58da7df6d638d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:56.748886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.750010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:56.752463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 934/1843] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:56 2022] DELETE /identity/v3/projects/be7db2dbcfa448b2a3a58da7df6d638d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:56.753968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.757826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.771395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.772231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.772751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.773098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.775216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.850929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3397-d21a-47f2-85f4-0990ad3b6770 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:56.857265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.858899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.859448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.859935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.861944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.864473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.865474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.868049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92ef36-2463-4361-9cf9-bae6d6777102 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:56.884280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 935/1844] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:56.884280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.885163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.894625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 910/1845] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:56.901177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.901799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.902248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.927893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:56.929627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.944543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 911/1846] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:56.945755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:56.947416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:56.964249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2906-cb32-4ec5-ab02-5ab0a4f759d5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:56.970540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:56.971905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:56.972711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:56.973362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:56.974283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:56.976896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.000971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97044276-bc5e-4ea3-b419-4c84846dff73 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.005603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 912/1847] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:56 2022] POST /identity/v3/users => generated 291 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:57.006598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.009875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.010742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.011465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.011746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.012292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.014743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.028818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.029209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d9ef-e698-4a6f-b97e-bc437ead1c64 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.030631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.034007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.035080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.035673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.035936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] PATH_INFO: `/v3/users/58e26338d49f494ea8df1bd8a4ca069f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.037226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e26338d49f494ea8df1bd8a4ca069f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.039330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.043751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 936/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:57.044999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.059461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d8a6-98bb-41e6-80bc-d4922fdabfa3 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.067689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.069385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.069885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.070405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] PATH_INFO: `/v3/projects/60e5f12f31734894af556e690f2c8998/users/b5e31731e52a4ba092dd0d6730898f76/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.073729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e5f12f31734894af556e690f2c8998, user_id=b5e31731e52a4ba092dd0d6730898f76, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.078022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.098485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:57.117301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 937/1849] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:57 2022] PUT /identity/v3/projects/60e5f12f31734894af556e690f2c8998/users/b5e31731e52a4ba092dd0d6730898f76/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:57.121414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.156649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e26338d49f494ea8df1bd8a4ca069f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.175293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e26338d49f494ea8df1bd8a4ca069f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.176964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e26338d49f494ea8df1bd8a4ca069f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.194266 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e26338d49f494ea8df1bd8a4ca069f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.219191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e26338d49f494ea8df1bd8a4ca069f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.231039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 913/1850] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:57 2022] DELETE /identity/v3/users/58e26338d49f494ea8df1bd8a4ca069f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:57.234375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.236856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.248299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20365b-5f0b-41e6-a65d-ad36ed16c0a2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.272958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:57.368139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc86d0-ff73-4dc1-abfc-c0d0390a00ba admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.392685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f7572-440c-49c0-be6b-ca4eccfdae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.394475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7572-440c-49c0-be6b-ca4eccfdae60 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.396896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7572-440c-49c0-be6b-ca4eccfdae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.397899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f7572-440c-49c0-be6b-ca4eccfdae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.398740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7572-440c-49c0-be6b-ca4eccfdae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.400705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f7572-440c-49c0-be6b-ca4eccfdae60 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.405349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.406849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.407421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.407966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.409851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:57.410669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.414268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.422004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 914/1851] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:57.422004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.422004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.422004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.439852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 938/1852] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:57.441117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.456235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50109f-20d0-457c-b9cf-cc620647a65c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.464366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.466074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.466616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.467274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] PATH_INFO: `/v3/projects/ee5f69707da1457e94e506f082c9ac1c/users/da6787f3763347dbaae445cc17731b4c/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.487710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5f69707da1457e94e506f082c9ac1c, user_id=da6787f3763347dbaae445cc17731b4c, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.490929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.497241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] MFA Rules not processed for user `b5e31731e52a4ba092dd0d6730898f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:57.499442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.518627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 939/1853] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:57 2022] PUT /identity/v3/projects/ee5f69707da1457e94e506f082c9ac1c/users/da6787f3763347dbaae445cc17731b4c/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:57.521865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.528344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.626441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea487ca-c70a-4063-84b0-d13e97199fa7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.632249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.632950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.633269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.633570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.634319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.636629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.672761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 915/1854] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:57.673959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.682757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 940/1855] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:57 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:57.682757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.683630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.710731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db71f-70e6-4b8f-a894-c1cb6d036e84 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.742521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:57.783035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e977-3afb-478b-9b73-c73c0f148a75 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.791759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.792811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.793156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.793498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] PATH_INFO: `/v3/projects/21bed6bd7b0b419aa0b130fee7f2cd72` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.794877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bed6bd7b0b419aa0b130fee7f2cd72)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.798088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.814565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.815737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.816307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.816307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.817035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.817353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:57.818887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.834043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 916/1856] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:57.834043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.848855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6c433-bd2c-4444-99bb-f09a2a5c095c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:57.854300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:57.855294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:57.855587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:57.855862 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:57.856871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:57.858851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:57.876661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bed6bd7b0b419aa0b130fee7f2cd72', 'request_id': 'req-02aa9be7-5aba-49bf-a984-658702c1176e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.886596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 917/1857] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:57 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:57.887798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bed6bd7b0b419aa0b130fee7f2cd72', 'request_id': 'req-02aa9be7-5aba-49bf-a984-658702c1176e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.895046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.896197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bed6bd7b0b419aa0b130fee7f2cd72', 'request_id': 'req-02aa9be7-5aba-49bf-a984-658702c1176e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.899319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.914610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] The token cache is being invalidate because project 21bed6bd7b0b419aa0b130fee7f2cd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:57.915574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.916416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:57.919897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 941/1858] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:57 2022] DELETE /identity/v3/projects/21bed6bd7b0b419aa0b130fee7f2cd72 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:57.920113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:57.922012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:57.972760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3aec-b7e0-419a-945b-52cb6b8bbf69 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.056220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9be7-5aba-49bf-a984-658702c1176e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.060375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.061140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.061467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.061757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.065144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.066832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.067865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.068139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.068417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] PATH_INFO: `/v3/projects/ee5f69707da1457e94e506f082c9ac1c/users/da6787f3763347dbaae445cc17731b4c/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.070740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5f69707da1457e94e506f082c9ac1c, user_id=da6787f3763347dbaae445cc17731b4c, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.075353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.089293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 942/1859] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:57 2022] PUT /identity/v3/projects/ee5f69707da1457e94e506f082c9ac1c/users/da6787f3763347dbaae445cc17731b4c/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:58.090308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.100680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.159104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.160820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.173379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 918/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:58.174297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.178301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.186573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:58.192364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d2ef-cbf5-4935-a257-ee704e8d2c60 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.254722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f174db9-9c44-4f2c-a511-1c3b142f7b1e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.267758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.268629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.269128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.269478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.270704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.272020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.288373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 943/1861] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:58.289277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.291910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.292578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.292844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.293129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.293401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] PATH_INFO: `/v3/users/fc42c844ab01492ea74a1fbbca5f70a4` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.294795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc42c844ab01492ea74a1fbbca5f70a4)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.296901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.305572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead520f-590d-4ff2-974d-4b89481d64a5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.310670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.311569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.311843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.312108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] PATH_INFO: `/v3/projects/c582b120da4140d49476fdac6cb0eb39` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.314669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c582b120da4140d49476fdac6cb0eb39)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.316090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.351651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc42c844ab01492ea74a1fbbca5f70a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.351872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:58.360113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc42c844ab01492ea74a1fbbca5f70a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.361054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc42c844ab01492ea74a1fbbca5f70a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.370610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc42c844ab01492ea74a1fbbca5f70a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.372224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c582b120da4140d49476fdac6cb0eb39', 'request_id': 'req-b7c5aab4-61f4-4708-9f89-14155386d570'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.383235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c582b120da4140d49476fdac6cb0eb39', 'request_id': 'req-b7c5aab4-61f4-4708-9f89-14155386d570'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.389777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c582b120da4140d49476fdac6cb0eb39', 'request_id': 'req-b7c5aab4-61f4-4708-9f89-14155386d570'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.389970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6470fbbb-0356-4252-ba17-97415180da50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc42c844ab01492ea74a1fbbca5f70a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.396871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 919/1862] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:58 2022] DELETE /identity/v3/users/fc42c844ab01492ea74a1fbbca5f70a4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:58.398515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.398802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.399121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.408457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] The token cache is being invalidate because project c582b120da4140d49476fdac6cb0eb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:58.408978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.409525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:58.415570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 944/1863] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:58 2022] DELETE /identity/v3/projects/c582b120da4140d49476fdac6cb0eb39 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:58.416685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.418272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.436796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] MFA Rules not processed for user `da6787f3763347dbaae445cc17731b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:58.438167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.492866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5aab4-61f4-4708-9f89-14155386d570 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.544228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 920/1864] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:58.545189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.547041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.559030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:58.596562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.597381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.597617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.597908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.600548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.633519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25253a0-a8a4-4d0c-8735-db74a7d42e82 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.640335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01073789-51ef-45f8-b518-7dc47ef204bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.641029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01073789-51ef-45f8-b518-7dc47ef204bf admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.641313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01073789-51ef-45f8-b518-7dc47ef204bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.641585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01073789-51ef-45f8-b518-7dc47ef204bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.642324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01073789-51ef-45f8-b518-7dc47ef204bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.644019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01073789-51ef-45f8-b518-7dc47ef204bf admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.656875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 921/1865] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:58.658185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.660279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.660279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.679573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:58.680800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.686236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.687805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.695650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 922/1866] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:58.695650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.695650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.698165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 945/1867] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:58.698545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.704337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e810a-af10-4267-b779-7ce29086ce81 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.708719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2d567-d500-4e3e-84bc-4a34731d2859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.709406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2d567-d500-4e3e-84bc-4a34731d2859 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.709671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2d567-d500-4e3e-84bc-4a34731d2859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.709949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2d567-d500-4e3e-84bc-4a34731d2859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.710481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383091e4-3377-48fd-b01e-0aefdcae95aa service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.716399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf4c25-2da4-49b4-873b-9380c75b2e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.717605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf4c25-2da4-49b4-873b-9380c75b2e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.717888 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf4c25-2da4-49b4-873b-9380c75b2e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.718340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf4c25-2da4-49b4-873b-9380c75b2e50 admin admin] PATH_INFO: `/v3/projects/c343d800227f4a39b793f1bcfab56a68/users/b32f49bc05384df39f07329fd2c1246c/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.722574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2d567-d500-4e3e-84bc-4a34731d2859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.724065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2d567-d500-4e3e-84bc-4a34731d2859 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.735347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 923/1868] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:58.736614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.737057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.737487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.738334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf4c25-2da4-49b4-873b-9380c75b2e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c343d800227f4a39b793f1bcfab56a68, user_id=b32f49bc05384df39f07329fd2c1246c, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.741918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf4c25-2da4-49b4-873b-9380c75b2e50 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.753882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:58.762618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 946/1869] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:58 2022] PUT /identity/v3/projects/c343d800227f4a39b793f1bcfab56a68/users/b32f49bc05384df39f07329fd2c1246c/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:58.765353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:58.768140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.783223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.784355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.784920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.843272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] MFA Rules not processed for user `b32f49bc05384df39f07329fd2c1246c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:58.844630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.892249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 924/1870] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:58.894606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.897076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:58.912346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac56c-1bc7-4577-9ef1-207c443ee368 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.918352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.919671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.920143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.920330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] PATH_INFO: `/v3/projects/581329d876b64b27a0c9b23eeb944a5d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.921725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581329d876b64b27a0c9b23eeb944a5d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.923704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:58.955352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 947/1871] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:58.956465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:58.971358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090d4a6-bce4-49d4-8c54-43f3ec11d666 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:58.977177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:58.977954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:58.978289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:58.978655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:58.979556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:58.979959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:58.981750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.000413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 948/1872] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:59.000413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.000413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:59.004745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581329d876b64b27a0c9b23eeb944a5d', 'request_id': 'req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:59.024127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581329d876b64b27a0c9b23eeb944a5d', 'request_id': 'req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:59.037542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581329d876b64b27a0c9b23eeb944a5d', 'request_id': 'req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:59.070486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] The token cache is being invalidate because project 581329d876b64b27a0c9b23eeb944a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:59.072666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:59.073901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:59.081724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 925/1873] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:58 2022] DELETE /identity/v3/projects/581329d876b64b27a0c9b23eeb944a5d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:59.082693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.085381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:59.112354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:59.112925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6289-9d4c-49b8-94c0-4420316e5764 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.230498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.231836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.232529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.232972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.236993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:59.253668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:59.279158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc488c-4663-49fc-9d46-0d6d7b7b06d0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.291287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ff1e-6f21-45b3-9835-4cb8a9ef2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.293074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ff1e-6f21-45b3-9835-4cb8a9ef2c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.293567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ff1e-6f21-45b3-9835-4cb8a9ef2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.294326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ff1e-6f21-45b3-9835-4cb8a9ef2c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.296298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ff1e-6f21-45b3-9835-4cb8a9ef2c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.298926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ff1e-6f21-45b3-9835-4cb8a9ef2c42 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.347477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 926/1874] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:59 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:59.349204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd48405-e60c-4760-a974-af83ed0441ce None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.349504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd48405-e60c-4760-a974-af83ed0441ce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.349987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd48405-e60c-4760-a974-af83ed0441ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.359102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.362908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.372531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2dd48405-e60c-4760-a974-af83ed0441ce None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:59.374409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2dd48405-e60c-4760-a974-af83ed0441ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:59.400089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 949/1875] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:59.401364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.416230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa9dba-e656-4cb7-832b-f55ff8afa8ea service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.465832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 927/1876] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:59.476776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.477146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.477526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.506185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:59.506185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:59.566003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 928/1877] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:59.574747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.606424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737bd5b-c4e8-4b6e-b1ca-0adc53a8265b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.629322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.630451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.630770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.631091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.631954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:38:59.632272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.643948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.665175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.677500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.681363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.681363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.683528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.684078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 929/1878] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:38:59.685234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.687273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.705837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1694-703f-4102-b6c9-6cff25b9f921 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.712610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.713540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.713823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.714182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.717965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.718105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 950/1879] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:59 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:59.719043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.719474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.740432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ec35-4daa-41fc-9086-76f0730d1264 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.750814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.751650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.751928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.752505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.754902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.758045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.774473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 930/1880] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:38:59 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:59.775281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 951/1881] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:59.781505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.781969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.797083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ad3f-deea-43c9-91c4-f04663ce202e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.860409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:59.882568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b78f-b1b5-4883-8cf8-b67927c25aa5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.889907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.890840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.891447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.891800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.894026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.907669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.914156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:59.914925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:59.915324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:59.915688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:59.916772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:59.918627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:59.930320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 931/1882] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:38:59.937073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.959305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 952/1883] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:38:59 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:38:59.963913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:59.983136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939cd1e-5699-4f04-9b63-2f88eab26753 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.984612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a9fb-c943-47cf-9c60-c0178cb39558 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:59.998634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b2e11-374b-4da3-8f13-604cc3c41996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.000030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2e11-374b-4da3-8f13-604cc3c41996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.000509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2e11-374b-4da3-8f13-604cc3c41996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.001005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2e11-374b-4da3-8f13-604cc3c41996 admin admin] PATH_INFO: `/v3/projects/75db49feda744aeea588f9fa77edd1c5/users/4f117a205fd64cae9ca68003b27851c2/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.010389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.011084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.011350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.011623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.012358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.017724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.028189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b2e11-374b-4da3-8f13-604cc3c41996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75db49feda744aeea588f9fa77edd1c5, user_id=4f117a205fd64cae9ca68003b27851c2, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.032583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b2e11-374b-4da3-8f13-604cc3c41996 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.043731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 953/1884] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:00.050752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.072103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 932/1885] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:38:59 2022] PUT /identity/v3/projects/75db49feda744aeea588f9fa77edd1c5/users/4f117a205fd64cae9ca68003b27851c2/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:00.075432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.076216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.076962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.084603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40aff8-e22c-4985-8df8-8f4a0fae39de admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:00.095522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:00.149131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] MFA Rules not processed for user `4f117a205fd64cae9ca68003b27851c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:00.150649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.243507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.244598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.244598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.245235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.246075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.247967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.283421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 954/1886] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:00.283421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.289044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.300188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 933/1887] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:00.305866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.318505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9882680-ae65-4865-9c31-ecd497af2562 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:00.333720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.334771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7d342-0c30-44fd-aeb0-5ea2200e8672 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:00.335252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.337103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.337722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] PATH_INFO: `/v3/users/b32f49bc05384df39f07329fd2c1246c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.339582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32f49bc05384df39f07329fd2c1246c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.344330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.347394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.348449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.350431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.350869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] PATH_INFO: `/v3/projects/1a493bfc7a3144a4821f3dd80a62f282/users/57ca00cba4694f408960b7d70d70c681/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.387969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a493bfc7a3144a4821f3dd80a62f282, user_id=57ca00cba4694f408960b7d70d70c681, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.395346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.431596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 934/1888] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:00 2022] PUT /identity/v3/projects/1a493bfc7a3144a4821f3dd80a62f282/users/57ca00cba4694f408960b7d70d70c681/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:00.432688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.468913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32f49bc05384df39f07329fd2c1246c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:00.484413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32f49bc05384df39f07329fd2c1246c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:00.487125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32f49bc05384df39f07329fd2c1246c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:00.505471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32f49bc05384df39f07329fd2c1246c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:00.506287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf592e8f-f6c9-412f-b86c-05e0d41d525c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32f49bc05384df39f07329fd2c1246c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:00.543474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 955/1889] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:00 2022] DELETE /identity/v3/users/b32f49bc05384df39f07329fd2c1246c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:00.546295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74671f19-4c64-4897-8719-73c8a409a155 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.547691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74671f19-4c64-4897-8719-73c8a409a155 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.548094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74671f19-4c64-4897-8719-73c8a409a155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.600843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-74671f19-4c64-4897-8719-73c8a409a155 None None] MFA Rules not processed for user `57ca00cba4694f408960b7d70d70c681`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:00.602089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-74671f19-4c64-4897-8719-73c8a409a155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.632538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a5388-3229-4518-a56c-97128d40330a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:00.708051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 956/1890] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:00.710706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57abf51-be2b-4269-956c-333562dda864 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.715071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:00.717523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57abf51-be2b-4269-956c-333562dda864 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.718476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57abf51-be2b-4269-956c-333562dda864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.747927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:00.760546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d57abf51-be2b-4269-956c-333562dda864 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:00.763069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d57abf51-be2b-4269-956c-333562dda864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.772804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.773492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.773774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.774089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.774793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.776767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.813792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 935/1891] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/projects => generated 387 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:00.813792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.814152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.850165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 957/1892] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:00.851548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57abf51-be2b-4269-956c-333562dda864 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.852896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d57abf51-be2b-4269-956c-333562dda864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.865555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57abf51-be2b-4269-956c-333562dda864 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:00.901857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd38e-800a-4a3c-9cad-12d0aa4d8780 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:00.907474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.908156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.908440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.908717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.909421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.911412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.928240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:00.928965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:00.929257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:00.929562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:00.930323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:00.932518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:00.943761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 936/1893] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:00.944894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.950334 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:00.970820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 958/1894] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:00.971915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:00.985237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412682-9d7b-4d4f-ae88-15403230e794 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.025138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b43e3-4834-4eb8-9718-e07f6dac464d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.028837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.029837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.030124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.030397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.071937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.072780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.073067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.073348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.074036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.076023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.101039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 959/1895] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:00 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:01.101767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.109074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:01.110497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.112136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.113716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0b95-312c-4277-a420-7c3a879c3760 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.119791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.120767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.121218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.121659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.122678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.124884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.125991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 937/1896] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:01.127028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.128641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.137314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 960/1897] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:01.138708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.148412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64882091-2f8f-4cf5-b8c6-ac8c64474c5c service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.148965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43980143-02ba-46d8-9d1c-04722e97a57d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.154916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.155112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.156265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.156548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.156706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.156808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.157119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.157542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.157651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] PATH_INFO: `/v3/users/2d957f4b57044932afea07e527ab19f4` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.159271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d957f4b57044932afea07e527ab19f4)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.159445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.162205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.175561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 961/1898] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:01.175561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.188270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:01.192963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e4843-1afa-49da-a10a-04e783e68a03 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.204700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.204700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.204700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.204700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.205227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.205227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.219693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 962/1899] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:01.219693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.231948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c905e4-3f86-44bc-9af7-28c80fce5fcf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.235924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d957f4b57044932afea07e527ab19f4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.238896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.240017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.240380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.240654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] PATH_INFO: `/v3/projects/5fc0b5581fc840e99882148cb6704c20/users/b81f2c8fc2fd4eb4a2f658984a3a8f8f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.246866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d957f4b57044932afea07e527ab19f4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.247869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d957f4b57044932afea07e527ab19f4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.256483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d957f4b57044932afea07e527ab19f4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.259519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc0b5581fc840e99882148cb6704c20, user_id=b81f2c8fc2fd4eb4a2f658984a3a8f8f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.261841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.275419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d957f4b57044932afea07e527ab19f4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.278771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 963/1900] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:01 2022] PUT /identity/v3/projects/5fc0b5581fc840e99882148cb6704c20/users/b81f2c8fc2fd4eb4a2f658984a3a8f8f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.279900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.281763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.282443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 938/1901] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:01 2022] DELETE /identity/v3/users/2d957f4b57044932afea07e527ab19f4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.285343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.285343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.362683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565e898-5714-49a1-8cba-30048e7800a7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.363416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129a1d0-73dd-4d53-b286-aaf8fd61cc1f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.368699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cb8e1-eb29-45ba-a6cf-ccbaee65c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.369150 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.379860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.380177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.380424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] PATH_INFO: `/v3/projects/860eee3eb4294b40945aed2a18966e58/users/a690f8a87502490ab33f5367dcc4d999/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.380700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cb8e1-eb29-45ba-a6cf-ccbaee65c1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.380992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cb8e1-eb29-45ba-a6cf-ccbaee65c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.381268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cb8e1-eb29-45ba-a6cf-ccbaee65c1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.382030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cb8e1-eb29-45ba-a6cf-ccbaee65c1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.384239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cb8e1-eb29-45ba-a6cf-ccbaee65c1c2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.395898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 939/1902] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:01.396831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96fad-225d-4a3b-a08b-1426ee92b11e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.397121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96fad-225d-4a3b-a08b-1426ee92b11e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.397395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96fad-225d-4a3b-a08b-1426ee92b11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.402377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=860eee3eb4294b40945aed2a18966e58, user_id=a690f8a87502490ab33f5367dcc4d999, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.405282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.421597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 964/1903] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:01 2022] PUT /identity/v3/projects/860eee3eb4294b40945aed2a18966e58/users/a690f8a87502490ab33f5367dcc4d999/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.422455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.423507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5db96fad-225d-4a3b-a08b-1426ee92b11e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:01.425162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5db96fad-225d-4a3b-a08b-1426ee92b11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.503526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920770af-d7c3-4546-9dce-eca2b785c81d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.508545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.509484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.509761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.510034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] PATH_INFO: `/v3/projects/5fc0b5581fc840e99882148cb6704c20/users/b81f2c8fc2fd4eb4a2f658984a3a8f8f/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.512109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc0b5581fc840e99882148cb6704c20, user_id=b81f2c8fc2fd4eb4a2f658984a3a8f8f, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.514226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 940/1904] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:01.515489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.516674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f238-c74d-4d59-a788-5a47089d0123 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.517378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f238-c74d-4d59-a788-5a47089d0123 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.518085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f238-c74d-4d59-a788-5a47089d0123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.526355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:01.527774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 965/1905] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:01 2022] PUT /identity/v3/projects/5fc0b5581fc840e99882148cb6704c20/users/b81f2c8fc2fd4eb4a2f658984a3a8f8f/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.528778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.530550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.556499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d5c0f238-c74d-4d59-a788-5a47089d0123 None None] MFA Rules not processed for user `a690f8a87502490ab33f5367dcc4d999`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:01.557813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d5c0f238-c74d-4d59-a788-5a47089d0123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.590965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:01.599884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ea58-7d7c-4df9-a47a-d3af69083528 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.604967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.605641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.605925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.606201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.647638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 941/1906] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:01.652354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.652647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.652922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.675540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.677160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.679698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] MFA Rules not processed for user `b81f2c8fc2fd4eb4a2f658984a3a8f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:01.680901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.687207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 966/1907] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:01.688012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.689353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.702811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10628fee-0424-46aa-9eb6-39c3abbcd38c service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.708730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.709627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.710027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.710432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] PATH_INFO: `/v3/projects/c343d800227f4a39b793f1bcfab56a68` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.711832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c343d800227f4a39b793f1bcfab56a68)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.714621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.780377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 942/1908] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:01.781486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.799657 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a109e99-e04b-4d06-a8fb-6ee59b636d04 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.817514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c343d800227f4a39b793f1bcfab56a68', 'request_id': 'req-ade3bc6b-9e71-463a-9486-27c76a8a8182'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.836286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c343d800227f4a39b793f1bcfab56a68', 'request_id': 'req-ade3bc6b-9e71-463a-9486-27c76a8a8182'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.843538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c343d800227f4a39b793f1bcfab56a68', 'request_id': 'req-ade3bc6b-9e71-463a-9486-27c76a8a8182'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.856190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] The token cache is being invalidate because project c343d800227f4a39b793f1bcfab56a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:01.856619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.857366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.859174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 967/1909] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:01 2022] DELETE /identity/v3/projects/c343d800227f4a39b793f1bcfab56a68 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.863477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.864982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.952140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96c06c-2850-4c90-a500-c54962456624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.953275 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96c06c-2850-4c90-a500-c54962456624 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.953818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96c06c-2850-4c90-a500-c54962456624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.954351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96c06c-2850-4c90-a500-c54962456624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.955371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96c06c-2850-4c90-a500-c54962456624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.958762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96c06c-2850-4c90-a500-c54962456624 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.959101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bc6b-9e71-463a-9486-27c76a8a8182 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.967496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.972239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.972468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.972753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.979774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.014032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 943/1910] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:02.017103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.017103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.019403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.042685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.061072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:02.063091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.071152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.134454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 944/1911] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:02.135353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.142112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.144229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.145951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.156206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 968/1912] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:02.156862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.156965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823516af-a855-4ffa-802a-8e04a132f940 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.158327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.163219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94145-8caf-4653-b28c-a064cebcd508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.164070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94145-8caf-4653-b28c-a064cebcd508 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.164955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94145-8caf-4653-b28c-a064cebcd508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.165371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94145-8caf-4653-b28c-a064cebcd508 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.166120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b94145-8caf-4653-b28c-a064cebcd508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.168766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b94145-8caf-4653-b28c-a064cebcd508 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.176129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2615-8b7d-4b55-b945-c06c0741bd11 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.185949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.186844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.189910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.190028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] PATH_INFO: `/v3/projects/df0396d86c55491fb172b23970f4bb58` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.193970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0396d86c55491fb172b23970f4bb58)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.196173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.215639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 945/1913] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/users => generated 299 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:02.221606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.221606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.221606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.260412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:02.265016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.280782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 946/1914] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:02.281690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.293730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e778594-0884-4cf4-8a54-2d9c2161a083 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.307713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0396d86c55491fb172b23970f4bb58', 'request_id': 'req-0d754150-06ab-4091-a2f5-6e50e724ef8a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.318880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0396d86c55491fb172b23970f4bb58', 'request_id': 'req-0d754150-06ab-4091-a2f5-6e50e724ef8a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.328894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0396d86c55491fb172b23970f4bb58', 'request_id': 'req-0d754150-06ab-4091-a2f5-6e50e724ef8a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.349942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] The token cache is being invalidate because project df0396d86c55491fb172b23970f4bb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:02.350240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.350949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.352686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 969/1915] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:02 2022] DELETE /identity/v3/projects/df0396d86c55491fb172b23970f4bb58 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:02.355633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.357707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.450930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.452345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.452830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.453315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.454475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.458376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.504887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 947/1916] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:02.508578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.516777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.529668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d754150-06ab-4091-a2f5-6e50e724ef8a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.545215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.546242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.546674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.547091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.547929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:02.548640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.550417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.557423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e8358-97e6-4356-9732-17c8d5e85708 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.569226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.572044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.572355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.572934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] PATH_INFO: `/v3/users/da6787f3763347dbaae445cc17731b4c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.578458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6787f3763347dbaae445cc17731b4c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.583874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.591655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 970/1917] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:02.595059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.604038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.640437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b20a2-5166-457f-93ed-ee71186c9d0c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.648759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.649692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.649974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.652740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] PATH_INFO: `/v3/projects/3119b608b8a245fcb0c28fbb51744582/users/0df546769bf14f18ae4106fc0d4a434d/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.716441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3119b608b8a245fcb0c28fbb51744582, user_id=0df546769bf14f18ae4106fc0d4a434d, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.719486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.731168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6787f3763347dbaae445cc17731b4c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.748742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6787f3763347dbaae445cc17731b4c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.752163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 971/1918] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:02 2022] PUT /identity/v3/projects/3119b608b8a245fcb0c28fbb51744582/users/0df546769bf14f18ae4106fc0d4a434d/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:02.752503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6787f3763347dbaae445cc17731b4c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.753524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.762811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.777235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6787f3763347dbaae445cc17731b4c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.800288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.816483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6787f3763347dbaae445cc17731b4c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:02.819949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.829789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 948/1919] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:02 2022] DELETE /identity/v3/users/da6787f3763347dbaae445cc17731b4c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:02.831861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.850203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.869149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2a32c-a90b-40cd-822e-92599e75fd33 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.978361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a0d06-8198-40eb-ba7d-57b0bb48662f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.979923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.980645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.981133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.981465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.983559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.985031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.985939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.986219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.986393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.986539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.987491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.990185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.012470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 949/1920] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:03.020473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.032708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 972/1921] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/projects => generated 389 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:03.034033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.034435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77236-c6c6-4af4-a9e6-09863784b5ee admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.182920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cd12b-af25-47e3-b521-0178c4fbc860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.184294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389afb2-0348-4142-86bd-f697a043e5f1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.184539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd12b-af25-47e3-b521-0178c4fbc860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.184851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd12b-af25-47e3-b521-0178c4fbc860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.185255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd12b-af25-47e3-b521-0178c4fbc860 admin admin] PATH_INFO: `/v3/projects/3119b608b8a245fcb0c28fbb51744582/users/0df546769bf14f18ae4106fc0d4a434d/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.189222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cd12b-af25-47e3-b521-0178c4fbc860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3119b608b8a245fcb0c28fbb51744582, user_id=0df546769bf14f18ae4106fc0d4a434d, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.192603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.194089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.194577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.195059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.195983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.197738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cd12b-af25-47e3-b521-0178c4fbc860 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.198526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.230643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 950/1922] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:03 2022] PUT /identity/v3/projects/3119b608b8a245fcb0c28fbb51744582/users/0df546769bf14f18ae4106fc0d4a434d/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:03.235374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.235529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.235810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.237638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 973/1923] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:03.242733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.266280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038012-f7a3-4423-a395-fd39ca653034 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.297147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] MFA Rules not processed for user `0df546769bf14f18ae4106fc0d4a434d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:03.298965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.402084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:03.421220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.421952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.422481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.422481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.423265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.426321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.429557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 951/1924] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:03.436765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.440735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.442515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 974/1925] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:03.443673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.448193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.456139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:03.462255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc963b05-3d16-4a07-af9d-21e9aa91582b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.473020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.476017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.477250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.477734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] PATH_INFO: `/v3/projects/ee5f69707da1457e94e506f082c9ac1c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.479740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5f69707da1457e94e506f082c9ac1c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.483179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.526779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2929-1963-4f08-9889-79b8657a26e2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.531881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.532598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.532941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.533487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.547203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.549276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.553476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5f69707da1457e94e506f082c9ac1c', 'request_id': 'req-56f4e177-ae16-42b2-b812-7e3aafadd59c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:03.559798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5f69707da1457e94e506f082c9ac1c', 'request_id': 'req-56f4e177-ae16-42b2-b812-7e3aafadd59c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:03.564387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 975/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:03.565945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.568781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5f69707da1457e94e506f082c9ac1c', 'request_id': 'req-56f4e177-ae16-42b2-b812-7e3aafadd59c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:03.577941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42de04-a078-4418-af61-e4e4b02f767b service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.585500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] The token cache is being invalidate because project ee5f69707da1457e94e506f082c9ac1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:03.585852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:03.586668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-56f4e177-ae16-42b2-b812-7e3aafadd59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:03.589292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 952/1927] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:03 2022] DELETE /identity/v3/projects/ee5f69707da1457e94e506f082c9ac1c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:03.595151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78321508-efed-4ae7-8a31-18d2b5d57dd4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.595611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78321508-efed-4ae7-8a31-18d2b5d57dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.596659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78321508-efed-4ae7-8a31-18d2b5d57dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.621427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-78321508-efed-4ae7-8a31-18d2b5d57dd4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:03.622823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-78321508-efed-4ae7-8a31-18d2b5d57dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.696865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.698149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.698670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.699251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.700942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.703902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.711272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 953/1928] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:03.722724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 976/1929] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:03.725393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.725681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.726124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.729521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.739096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.754157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:03.756058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.757560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922120-0d4d-4f25-a685-d4dcb3f8b07d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.764482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd0d94-4070-4580-ba7f-ee1fc2175490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.765470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd0d94-4070-4580-ba7f-ee1fc2175490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.765860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd0d94-4070-4580-ba7f-ee1fc2175490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.771095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd0d94-4070-4580-ba7f-ee1fc2175490 admin admin] PATH_INFO: `/v3/projects/8389d2c99d304bd2b1fd724473833fdc/users/3ca744583801484ab8bf2789a4759f73/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.771849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 954/1930] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:03.776717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.787717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525188b-2432-41c2-a19f-d735dccf758e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.792732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd0d94-4070-4580-ba7f-ee1fc2175490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8389d2c99d304bd2b1fd724473833fdc, user_id=3ca744583801484ab8bf2789a4759f73, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.793697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.794379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.794659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.794937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.795557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd0d94-4070-4580-ba7f-ee1fc2175490 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.795824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:03.796065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.797949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.820263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 955/1931] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:03.821221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 977/1932] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:03 2022] PUT /identity/v3/projects/8389d2c99d304bd2b1fd724473833fdc/users/3ca744583801484ab8bf2789a4759f73/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:03.822679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.826378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.826801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.826980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.835251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de346f4-3ba6-47aa-8c99-dd0f0924a2af admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:03.862138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] MFA Rules not processed for user `3ca744583801484ab8bf2789a4759f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:03.864746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:03.947584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:03.963476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:03.965795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:03.967944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:03.968317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:03.969190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:03.975839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 978/1933] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:03.976521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:03.980113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:03.998709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:04.002106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1818-348f-4c3a-98e0-93a1967a535b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.011908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.012938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.013990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.014791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.016437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.022114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.040449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 956/1934] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:04.044882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.071593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 979/1935] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:03 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:04.077093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.192836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85dfa0-dd94-4a1e-8053-619e18685639 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.199451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.200598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.202000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.202460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.203619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.206160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.207316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055df04-8a05-4e4c-9c97-fed025c0de46 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.214266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.215159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.215527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.215930 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.216668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.218977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.237594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 957/1936] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:04 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:04.241858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.252739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 980/1937] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:04 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:04.254841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.266968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729ab84-3eab-4a97-b610-52be8bad67f5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.277926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83149be-c073-4e03-99c9-8845e2842717 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.278801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.279598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.279877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.280145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.280885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.282650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.289465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.290323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.290757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.291265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.292575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.295181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.311619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 981/1938] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:04.314936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.318016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 958/1939] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:04.330036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.330461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070321fb-271c-4db0-afad-ecad8405895f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.344039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.345081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.345408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.345669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] PATH_INFO: `/v3/projects/d30499af402b4def8d17f5e1a636ab07/users/67b0323fb23d4b149507f2d9ff727ff8/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.348479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195006d-9a27-4cb0-a0d7-c00f69baf633 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.366446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.367176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.367461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.367736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.368475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.386724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.388754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30499af402b4def8d17f5e1a636ab07, user_id=67b0323fb23d4b149507f2d9ff727ff8, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.391835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.409977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 959/1940] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:04.420408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 982/1941] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:04 2022] PUT /identity/v3/projects/d30499af402b4def8d17f5e1a636ab07/users/67b0323fb23d4b149507f2d9ff727ff8/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:04.427647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.428955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.456239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681fc8-bee6-4f87-a253-0c8817adce08 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.600824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879a358-4d0d-4f5a-b016-ec4f2fe8fc11 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.608981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.610161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.610815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.611571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.613090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.615955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.616847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.619666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.623023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.623492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] PATH_INFO: `/v3/projects/92227c3f9afd4170ac451b7a3d94fc6b/users/3103332aa1ff49a7ba75220421dbf44e/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.634796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 983/1942] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:04.635895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.639328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:04.657381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92227c3f9afd4170ac451b7a3d94fc6b, user_id=3103332aa1ff49a7ba75220421dbf44e, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.661416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.671356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:04.680634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 960/1943] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:04 2022] PUT /identity/v3/projects/92227c3f9afd4170ac451b7a3d94fc6b/users/3103332aa1ff49a7ba75220421dbf44e/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:04.681780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.734048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4f79-f615-4533-9853-439bf317b181 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.746381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:04.771734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da38e-0bb7-4fbd-a5a6-4dbc49358f24 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.777161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.778087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.778365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.778644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] PATH_INFO: `/v3/projects/d30499af402b4def8d17f5e1a636ab07/users/67b0323fb23d4b149507f2d9ff727ff8/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.780799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30499af402b4def8d17f5e1a636ab07, user_id=67b0323fb23d4b149507f2d9ff727ff8, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.783503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.794854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 961/1944] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:04 2022] PUT /identity/v3/projects/d30499af402b4def8d17f5e1a636ab07/users/67b0323fb23d4b149507f2d9ff727ff8/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:04.796432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:04.804928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:04.806887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.807583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.807861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.808159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.809891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:04.901928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de1fd-122e-40c1-9c7a-585d7f8a607a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:04.914838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:04.915792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.916689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.916689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] PATH_INFO: `/v3/users/075e25e6dcf34de493528c1a906c49b2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.920489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.921977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=075e25e6dcf34de493528c1a906c49b2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:04.925300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1de711-a8b9-4880-b9a7-c98b39cadee7 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.929931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:04.941735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 984/1945] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:04.953664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0c17b-b012-4f6b-8c08-1b3379d3eb55 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:04.953951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0c17b-b012-4f6b-8c08-1b3379d3eb55 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:04.954257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0c17b-b012-4f6b-8c08-1b3379d3eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:04.987470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d3a0c17b-b012-4f6b-8c08-1b3379d3eb55 None None] MFA Rules not processed for user `3103332aa1ff49a7ba75220421dbf44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:04.989372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d3a0c17b-b012-4f6b-8c08-1b3379d3eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.057717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075e25e6dcf34de493528c1a906c49b2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:05.075343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075e25e6dcf34de493528c1a906c49b2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:05.075957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075e25e6dcf34de493528c1a906c49b2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:05.094957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075e25e6dcf34de493528c1a906c49b2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:05.103599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 985/1946] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:05.105070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ccea-6863-4d10-9487-8dc7b694c2be None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.105280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ccea-6863-4d10-9487-8dc7b694c2be None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.105556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ccea-6863-4d10-9487-8dc7b694c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.116917 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-aec1f1fe-f26c-4ce4-97fc-36096ae43a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075e25e6dcf34de493528c1a906c49b2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:05.134408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 962/1947] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:04 2022] DELETE /identity/v3/users/075e25e6dcf34de493528c1a906c49b2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:05.139367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe83a-77d9-4f85-8f24-a718dc1e25d6 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.140153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe83a-77d9-4f85-8f24-a718dc1e25d6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.141160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7ef0ccea-6863-4d10-9487-8dc7b694c2be None None] MFA Rules not processed for user `67b0323fb23d4b149507f2d9ff727ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:05.141482 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe83a-77d9-4f85-8f24-a718dc1e25d6 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.142739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7ef0ccea-6863-4d10-9487-8dc7b694c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.145800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 963/1948] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:39:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:39:05.147476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe83a-77d9-4f85-8f24-a718dc1e25d6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:05.148460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:05.151959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-018fe83a-77d9-4f85-8f24-a718dc1e25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.286057 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 986/1949] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:05.290237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352a98-2b6d-4fe1-ae43-9822d008e893 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.290639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352a98-2b6d-4fe1-ae43-9822d008e893 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.290982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352a98-2b6d-4fe1-ae43-9822d008e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.334771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-55352a98-2b6d-4fe1-ae43-9822d008e893 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:05.337460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-55352a98-2b6d-4fe1-ae43-9822d008e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.338832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:05.349188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe83a-77d9-4f85-8f24-a718dc1e25d6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:05.358512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 987/1950] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:05.359412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:05.360309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.361775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.362122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.362914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:05.366066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.366066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.366497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:05.366882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.422592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:05.424234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.441757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 964/1951] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:05 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:05.443755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:05.445714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.549681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c675-c7eb-4a62-b690-0754ce169016 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:05.555270 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:05.556296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.556769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.557096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.611999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 988/1952] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:39:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:05.612712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:05.617431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.671741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:05.673329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:05.685704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 965/1953] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:05.686825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:05.748886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6b8f7-627a-42a8-880b-157083e066a5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:05.791220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc1a2-7e2c-4988-9ebd-63be220fb75b service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:05.797248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:05.797827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.798243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.798520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.799382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:05.801436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:05.848915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 966/1954] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:05 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:05.850032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:05.851602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:05.853648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:05.875675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:05.878134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.880497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.880925 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.893831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:05.908390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:05.909853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:05.928033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 989/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:05.928865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:05.965596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae55e59-8927-44be-b936-f30fcf783f80 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:05.969478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27f849-d2d8-4f55-a670-f419a888ea19 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:05.971656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:05.972335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.972618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.973257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.975871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:05.976524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:05.976938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:05.977297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:05.978068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:05.980471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:05.983076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:05.985150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.003280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 990/1956] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:06.004263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.007645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.010162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 967/1957] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:06.012287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.025409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266bc99-42bd-48e4-acc2-a376f2c7d45e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.034362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.035807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.036298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.036685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] PATH_INFO: `/v3/users/3ca744583801484ab8bf2789a4759f73` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.037669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ebddd-0c8c-4fb7-bfbb-8da1ffbda747 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.038339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca744583801484ab8bf2789a4759f73)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.041088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.052503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.053629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.053748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.053948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] PATH_INFO: `/v3/projects/507c67e2394e476a9a4ddcbdd49e36e2/users/d5e3d3eb3ebe4a9ab2c077515a818925/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.093659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507c67e2394e476a9a4ddcbdd49e36e2, user_id=d5e3d3eb3ebe4a9ab2c077515a818925, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.096530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.116001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 968/1958] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:06 2022] PUT /identity/v3/projects/507c67e2394e476a9a4ddcbdd49e36e2/users/d5e3d3eb3ebe4a9ab2c077515a818925/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:06.119801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.131720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca744583801484ab8bf2789a4759f73'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.147787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca744583801484ab8bf2789a4759f73'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.148083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca744583801484ab8bf2789a4759f73'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.162641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca744583801484ab8bf2789a4759f73'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.169965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2853c325-c18b-4025-b72b-0408819065fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca744583801484ab8bf2789a4759f73'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.202379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 991/1959] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:06 2022] DELETE /identity/v3/users/3ca744583801484ab8bf2789a4759f73 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:06.206937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.207239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.207507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.229838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:06.231477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.247501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116e5ce-8ac7-41bc-b053-dbb545d33d35 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.319550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 992/1960] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:06.321100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.321800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.322142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.322363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.323167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.325494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.328885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.330382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.337409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 969/1961] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:06.342433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.344381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.359243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d188a45-3d76-4c93-bb25-050f1401ac8e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.364857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.365909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.366199 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.366480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] PATH_INFO: `/v3/projects/507c67e2394e476a9a4ddcbdd49e36e2/users/d5e3d3eb3ebe4a9ab2c077515a818925/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.375770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507c67e2394e476a9a4ddcbdd49e36e2, user_id=d5e3d3eb3ebe4a9ab2c077515a818925, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.378948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.392434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 970/1962] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:06 2022] PUT /identity/v3/projects/507c67e2394e476a9a4ddcbdd49e36e2/users/d5e3d3eb3ebe4a9ab2c077515a818925/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:06.400360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.402679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.406626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:06.411217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b05186-8898-4a89-bbd6-f1cf7ca607e2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.425408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:06.484406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735adfb-7e71-41e5-9412-9cccd89bf809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.485071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735adfb-7e71-41e5-9412-9cccd89bf809 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.485351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735adfb-7e71-41e5-9412-9cccd89bf809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.485623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735adfb-7e71-41e5-9412-9cccd89bf809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.495642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289bb4f-59c9-4c8f-a975-2454c06e3326 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.495871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735adfb-7e71-41e5-9412-9cccd89bf809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.497362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735adfb-7e71-41e5-9412-9cccd89bf809 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.500678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.501678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.502024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.502315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] PATH_INFO: `/v3/projects/8f0112a97f1d429fba5a1916c9c7096d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.503566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0112a97f1d429fba5a1916c9c7096d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.505573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.511228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 993/1963] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:06.516797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.517587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.518366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.559089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0112a97f1d429fba5a1916c9c7096d', 'request_id': 'req-79920845-67d1-41b8-a7f1-a82ea4eb0fed'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.565491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0112a97f1d429fba5a1916c9c7096d', 'request_id': 'req-79920845-67d1-41b8-a7f1-a82ea4eb0fed'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.574070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0112a97f1d429fba5a1916c9c7096d', 'request_id': 'req-79920845-67d1-41b8-a7f1-a82ea4eb0fed'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.574786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] MFA Rules not processed for user `d5e3d3eb3ebe4a9ab2c077515a818925`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:06.576070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.588203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] The token cache is being invalidate because project 8f0112a97f1d429fba5a1916c9c7096d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:06.588556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.589176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.594837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 971/1964] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:06 2022] DELETE /identity/v3/projects/8f0112a97f1d429fba5a1916c9c7096d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:06.595643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.597258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.683358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920845-67d1-41b8-a7f1-a82ea4eb0fed admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.690898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.691919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 994/1965] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:06.692381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.692381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.692619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] PATH_INFO: `/v3/users/b5e31731e52a4ba092dd0d6730898f76` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.693883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e31731e52a4ba092dd0d6730898f76)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.696157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.704567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:06.706585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.768132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:06.770502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e31731e52a4ba092dd0d6730898f76'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.784440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e31731e52a4ba092dd0d6730898f76'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.786448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e31731e52a4ba092dd0d6730898f76'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.792015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de1b94-5c22-42f6-a834-74d8f311c3aa None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:06.814806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:06.815725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:06.817459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:06.819588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:06.820448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e31731e52a4ba092dd0d6730898f76'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.823985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:06.858894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e31731e52a4ba092dd0d6730898f76'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:06.874698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 972/1966] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:06 2022] DELETE /identity/v3/users/b5e31731e52a4ba092dd0d6730898f76 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:06.915962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:06.942596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:06.944965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:06.994769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 995/1967] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:07.105757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:07.107590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:07.262871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aac880-8002-464b-b1e3-1b85ddefc262 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:07.269466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:07.271206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.271756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.272105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] PATH_INFO: `/v3/projects/8389d2c99d304bd2b1fd724473833fdc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:07.273526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8389d2c99d304bd2b1fd724473833fdc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:07.276114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:07.334890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:07.337169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:07.357678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db870445-e6c7-4b16-8eb2-69c34c10fa0a service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:07.406554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8389d2c99d304bd2b1fd724473833fdc', 'request_id': 'req-c58519ba-b4dc-408d-828e-923a64127376'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.431520 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8389d2c99d304bd2b1fd724473833fdc', 'request_id': 'req-c58519ba-b4dc-408d-828e-923a64127376'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.452225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8389d2c99d304bd2b1fd724473833fdc', 'request_id': 'req-c58519ba-b4dc-408d-828e-923a64127376'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.493292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] The token cache is being invalidate because project 8389d2c99d304bd2b1fd724473833fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:07.494554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.497141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.504623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 973/1968] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:07 2022] DELETE /identity/v3/projects/8389d2c99d304bd2b1fd724473833fdc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:07.507058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:07.541386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:07.556334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:07.557081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.557347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.557619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:07.562440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:07.700712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:07.731194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58519ba-b4dc-408d-828e-923a64127376 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:07.740877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:07.742201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.742708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.743332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] PATH_INFO: `/v3/users/67b0323fb23d4b149507f2d9ff727ff8` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:07.745201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b0323fb23d4b149507f2d9ff727ff8)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:07.750176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:07.759493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:07.767244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:07.796572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 996/1969] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:07.798359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:07.803993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:07.846682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee4e38-65e5-4781-afe9-c5c403689824 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:07.854645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b0323fb23d4b149507f2d9ff727ff8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.861325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:07.862413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.862591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.862926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] PATH_INFO: `/v3/projects/60e5f12f31734894af556e690f2c8998` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:07.865152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e5f12f31734894af556e690f2c8998)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:07.868109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:07.871217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b0323fb23d4b149507f2d9ff727ff8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.871892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b0323fb23d4b149507f2d9ff727ff8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.888780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b0323fb23d4b149507f2d9ff727ff8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.925902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc780c39-53cd-4f6c-88f9-4af33f94de5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b0323fb23d4b149507f2d9ff727ff8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.944237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 974/1970] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:07 2022] DELETE /identity/v3/users/67b0323fb23d4b149507f2d9ff727ff8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:07.952905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e5f12f31734894af556e690f2c8998', 'request_id': 'req-12ac2254-ab44-4a41-a286-aa6f0dd56120'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.963239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e5f12f31734894af556e690f2c8998', 'request_id': 'req-12ac2254-ab44-4a41-a286-aa6f0dd56120'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.972288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e5f12f31734894af556e690f2c8998', 'request_id': 'req-12ac2254-ab44-4a41-a286-aa6f0dd56120'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.986856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] The token cache is being invalidate because project 60e5f12f31734894af556e690f2c8998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:07.987421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.988163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-12ac2254-ab44-4a41-a286-aa6f0dd56120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:07.990095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 997/1971] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:07 2022] DELETE /identity/v3/projects/60e5f12f31734894af556e690f2c8998 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:07.995349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.995635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.995910 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.023710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:08.025725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.162608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 975/1972] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:08.172122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.172713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.173321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.219429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:08.220699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.247684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 998/1973] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:08.252486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.267281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5212b3-f1a9-4aa8-94ff-5e6cd5d88081 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.279791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.282028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.282518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.283158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.286696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:08.287144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.291295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.318900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 976/1974] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:39:08.322589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.349250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a0d26-682e-46c8-a4c3-3a3cdcd2952a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.362734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.363570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.365198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.365431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.366264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.380517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.427035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.465600 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 999/1975] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:08 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:08.468581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.484016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bf02-a319-48cf-9f99-a13aa0d73339 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.596848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.597638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.598133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.598600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.599666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.601987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.613553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.643804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 977/1976] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:08 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:08.650436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.677710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c0deb-4ac0-4b38-83ee-a6f82d332f17 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.688481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.689838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.690336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.690790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.692182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.695147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.716197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1000/1977] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:08.720045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.747800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffe49-7b26-4b7d-8295-74e43b7c7a4f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.754813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d17c1c-fe84-40fd-81df-85ed924ef240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.755423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d17c1c-fe84-40fd-81df-85ed924ef240 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.755806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d17c1c-fe84-40fd-81df-85ed924ef240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.756119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d17c1c-fe84-40fd-81df-85ed924ef240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.756908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d17c1c-fe84-40fd-81df-85ed924ef240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.758931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d17c1c-fe84-40fd-81df-85ed924ef240 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.773268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 978/1978] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:08.777279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.789174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a5b9f-ed07-4411-968b-c232e2320401 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.802675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.804293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.804592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.805415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] PATH_INFO: `/v3/projects/128f14a38136453484a6afaee64c828d/users/00843685b70047e8bc73aca22e02433e/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.833889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128f14a38136453484a6afaee64c828d, user_id=00843685b70047e8bc73aca22e02433e, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.840341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.872427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1001/1979] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:08 2022] PUT /identity/v3/projects/128f14a38136453484a6afaee64c828d/users/00843685b70047e8bc73aca22e02433e/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:08.883240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.883601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.883946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.959414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] MFA Rules not processed for user `00843685b70047e8bc73aca22e02433e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:08.961208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:09.142925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 979/1980] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:09.143355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.220819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4737f-208b-47e3-8c6f-217463984339 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.228003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.228923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.242869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.243455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.245091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.253150 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.314095 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.316265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:09.340338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1002/1981] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:09.342116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.353850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2893df-29af-4b77-ab42-8715ec0c038a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.450163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.451767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.452263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.452845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] PATH_INFO: `/v3/projects/d30499af402b4def8d17f5e1a636ab07` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.454307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30499af402b4def8d17f5e1a636ab07)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.457066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.468606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e43e5-4563-4bc9-bab0-1d2014255062 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.475768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.476475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.476756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.477028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.477731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.480177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.508684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1003/1982] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:09.513588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.525745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30499af402b4def8d17f5e1a636ab07', 'request_id': 'req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:09.533481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30499af402b4def8d17f5e1a636ab07', 'request_id': 'req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:09.546934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30499af402b4def8d17f5e1a636ab07', 'request_id': 'req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:09.552844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011cf9c-cf3a-4e92-9d6e-9491d2635dac admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.561412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:09.571571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] The token cache is being invalidate because project d30499af402b4def8d17f5e1a636ab07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:09.572063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:09.575908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6cb8a124-55f2-4f4f-9c4d-1726fd03d861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:09.578597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 980/1983] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:09 2022] DELETE /identity/v3/projects/d30499af402b4def8d17f5e1a636ab07 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:09.586914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.587501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.588130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.609043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:09.622543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:09.624207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:09.648411 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.649135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.649416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.649708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.650832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.652218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.664398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1004/1984] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:09.670367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.672310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:09.692297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2886eb5-8e29-44c0-a83e-33a1931b54fa admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.712285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ce9e2-f8ee-4be7-8b32-fff0de837f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.713275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ce9e2-f8ee-4be7-8b32-fff0de837f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.714208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ce9e2-f8ee-4be7-8b32-fff0de837f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.714490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ce9e2-f8ee-4be7-8b32-fff0de837f30 admin admin] PATH_INFO: `/v3/projects/0b970ecbb51d405f90d6104979a40d18/users/318c9d22bd9c42809287dd837849c324/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.745522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ce9e2-f8ee-4be7-8b32-fff0de837f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b970ecbb51d405f90d6104979a40d18, user_id=318c9d22bd9c42809287dd837849c324, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.749819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ce9e2-f8ee-4be7-8b32-fff0de837f30 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.772110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 981/1985] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:09.776622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1005/1986] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:09 2022] PUT /identity/v3/projects/0b970ecbb51d405f90d6104979a40d18/users/318c9d22bd9c42809287dd837849c324/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:09.782363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.782644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.783410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.783722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.814911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9446b02-1021-4b76-915d-19f3d733bead None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.815857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:09.817144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:09.886888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.887788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.888435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.888754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.889602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.890985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1006/1987] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:09.894414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.895148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.905567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d988fc-113e-4d41-bc12-4f239f4509cb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.910386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 982/1988] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:09.911304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.911484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.912003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.912285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.912718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.913476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:09.913779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.915516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.925767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff853c-6f19-483c-9041-edb038e83b9b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.931461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553c487-9768-4698-9572-ef5848bb2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:09.932389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c487-9768-4698-9572-ef5848bb2a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.932671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c487-9768-4698-9572-ef5848bb2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.932951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c487-9768-4698-9572-ef5848bb2a0c admin admin] PATH_INFO: `/v3/projects/0b970ecbb51d405f90d6104979a40d18/users/318c9d22bd9c42809287dd837849c324/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.935222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553c487-9768-4698-9572-ef5848bb2a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b970ecbb51d405f90d6104979a40d18, user_id=318c9d22bd9c42809287dd837849c324, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:09.937634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1007/1989] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:39:09.938541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553c487-9768-4698-9572-ef5848bb2a0c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:09.938655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:09.950677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4d339-b92a-403f-9ef4-04cffa19d6ef admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:09.952255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 983/1990] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:09 2022] PUT /identity/v3/projects/0b970ecbb51d405f90d6104979a40d18/users/318c9d22bd9c42809287dd837849c324/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:09.965181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.965586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.966003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.011528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] MFA Rules not processed for user `318c9d22bd9c42809287dd837849c324`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:10.012849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:10.051988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.052700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.053159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.053438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.054142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.056144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.091305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1008/1991] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/projects => generated 409 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:10.103548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.120930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 984/1992] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:10.122195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.123845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:10.126492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:10.142382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:10.183532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439ff72-bb3c-450f-a86f-56bcdd77d810 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.189430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.190122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.190404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.190682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.191426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.193367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.201883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbe564-ee10-4c4e-ad4c-486b04aeecc3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.220868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1009/1993] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:10 2022] POST /identity/v3/users => generated 305 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:10.220868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.220868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:10.269810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.270749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.271229 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.271671 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.274463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:10.308072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57842b57-f4bc-4aa3-81f7-175f16d07610 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.312850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.313754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.314225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.314648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.366013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.368222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.379472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 985/1994] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:10.380507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.394249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f787ec7-9e5f-4ff4-b914-81bea55b6e2c service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.401689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.402609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.402887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.403197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.403948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.405694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.410003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.412182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.417049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 986/1995] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:10.424122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.425549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1010/1996] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:10.436171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba819e-ba6b-4ef1-bd4f-c8c7f8b599a1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.442710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2d44-6c2b-4951-9db8-b97aa8c21dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.444389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2d44-6c2b-4951-9db8-b97aa8c21dee admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.445273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2d44-6c2b-4951-9db8-b97aa8c21dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.445435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2d44-6c2b-4951-9db8-b97aa8c21dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.446331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2d44-6c2b-4951-9db8-b97aa8c21dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.448264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2d44-6c2b-4951-9db8-b97aa8c21dee admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.462766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 987/1997] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:10.467624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.479755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650d87c-e7fe-4054-b6b6-017f7f97d248 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.484238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.485162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.485437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.485759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] PATH_INFO: `/v3/projects/f1cb1d284f514e108a4017d2743093b0/users/b136cff03dd24903ab6af799eb2e21a0/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.505347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cb1d284f514e108a4017d2743093b0, user_id=b136cff03dd24903ab6af799eb2e21a0, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.508434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.543961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1011/1998] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:10 2022] PUT /identity/v3/projects/f1cb1d284f514e108a4017d2743093b0/users/b136cff03dd24903ab6af799eb2e21a0/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:10.555960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.556249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.557198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.606555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] MFA Rules not processed for user `b136cff03dd24903ab6af799eb2e21a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:10.607885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:10.666026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:10.715410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 988/1999] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:10.720447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.770897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:10.825083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd0c8-99f8-430c-91a3-899c08129c9e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.831322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.834400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.834636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.835046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.835896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.837919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.871039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1012/2000] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:10 2022] POST /identity/v3/projects => generated 407 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:10.876449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.890340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02b753-0d3c-4687-9a48-b5c4226103b5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.986028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.986733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.987038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.987316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.988063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.990138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:11.019585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 989/2001] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:10 2022] POST /identity/v3/users => generated 310 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:11.023738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:11.036473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ced062-fc25-4cee-acee-f13b2f94ea6c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:11.045295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:11.045989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.046349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.046604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:11.047670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:11.049427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:11.081518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1013/2002] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:11.087361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:11.099784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c74bb-fd22-4ecf-82ee-6da41db711a4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:11.106029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:11.107369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.108083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.108608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] PATH_INFO: `/v3/projects/b871ae47b5af4326a18f569d20c5df28/users/69ce49e55d2d42b7b36b790d5124a790/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:11.128079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b871ae47b5af4326a18f569d20c5df28, user_id=69ce49e55d2d42b7b36b790d5124a790, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:11.131738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:11.166618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 990/2003] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:11 2022] PUT /identity/v3/projects/b871ae47b5af4326a18f569d20c5df28/users/69ce49e55d2d42b7b36b790d5124a790/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:11.171702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:11.196396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1610e40-f55c-41db-a56c-e510a243e088 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:11.211485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:11.298803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517120f-5405-42ab-8b16-8b6746872a44 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:11.303481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:11.304166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.304450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.304723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:11.306610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:11.338017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:11.339170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.343409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.345739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:11.346574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:11.352455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:11.366016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1014/2004] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:11.371258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:11.402078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a1086-44a3-43cb-ab38-321e009661a0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:11.408547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d655-5542-4113-b449-61887f4402e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:11.409454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d655-5542-4113-b449-61887f4402e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.409796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d655-5542-4113-b449-61887f4402e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.410099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d655-5542-4113-b449-61887f4402e1 admin admin] PATH_INFO: `/v3/projects/b871ae47b5af4326a18f569d20c5df28/users/69ce49e55d2d42b7b36b790d5124a790/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:11.413983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5d655-5542-4113-b449-61887f4402e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b871ae47b5af4326a18f569d20c5df28, user_id=69ce49e55d2d42b7b36b790d5124a790, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:11.426581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5d655-5542-4113-b449-61887f4402e1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:11.429604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:11.433310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:11.446698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:11.458429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1015/2005] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:11 2022] PUT /identity/v3/projects/b871ae47b5af4326a18f569d20c5df28/users/69ce49e55d2d42b7b36b790d5124a790/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:11.465439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 991/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:11.471303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.471652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.471936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:11.613332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] MFA Rules not processed for user `69ce49e55d2d42b7b36b790d5124a790`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:11.614731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:11.793968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1016/2007] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:11.904786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:11.918300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf90885-63aa-4e98-bef6-9a6e84ac44b8 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:11.987208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:11.987888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:11.988202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:11.988483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:12.000433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:12.001995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:12.015629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 992/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:12.318196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:12.335143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237224-4cc7-412f-a683-9510c4ba4baa None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:12.344780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221d36d-0f19-49a3-90c0-480f658c9875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:12.345966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221d36d-0f19-49a3-90c0-480f658c9875 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:12.347780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221d36d-0f19-49a3-90c0-480f658c9875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:12.348000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221d36d-0f19-49a3-90c0-480f658c9875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:12.374229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:12.397010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:12.528666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221d36d-0f19-49a3-90c0-480f658c9875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:12.531304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d0bb3-8582-4045-b5b9-190920a1ed06 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:12.533450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221d36d-0f19-49a3-90c0-480f658c9875 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:12.543921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:12.546065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:12.546955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:12.547466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] PATH_INFO: `/v3/users/00843685b70047e8bc73aca22e02433e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:12.553349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00843685b70047e8bc73aca22e02433e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:12.558366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1017/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:12.560295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:12.658321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00843685b70047e8bc73aca22e02433e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:12.688067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00843685b70047e8bc73aca22e02433e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:12.691522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00843685b70047e8bc73aca22e02433e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:12.725075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00843685b70047e8bc73aca22e02433e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:12.776099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00843685b70047e8bc73aca22e02433e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:12.801140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 993/2010] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:12 2022] DELETE /identity/v3/users/00843685b70047e8bc73aca22e02433e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:12.805880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:12.806184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:12.806438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:12.834128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:12.835492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:12.971697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1018/2011] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:12.992405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:12.995858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:13.086521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:13.188755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de019e4-3571-4bd6-8cea-b15bef4e8b1d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:13.195140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:13.195962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.196414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.196756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.225354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:13.227948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:13.245021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 994/2012] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:13.756066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:13.757641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:13.772190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b6400-a007-4d99-b574-acbb2658c99b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:13.778436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:13.779536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.779940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.780312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] PATH_INFO: `/v3/projects/128f14a38136453484a6afaee64c828d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.781645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128f14a38136453484a6afaee64c828d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:13.783718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:13.839145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128f14a38136453484a6afaee64c828d', 'request_id': 'req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.849344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128f14a38136453484a6afaee64c828d', 'request_id': 'req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.856596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128f14a38136453484a6afaee64c828d', 'request_id': 'req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.872900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] The token cache is being invalidate because project 128f14a38136453484a6afaee64c828d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:13.872900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.873847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.875929 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1019/2013] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:13 2022] DELETE /identity/v3/projects/128f14a38136453484a6afaee64c828d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:13.880661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:13.893841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c02a-c5ef-47fc-a244-45e5495003a9 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:13.969319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:13.970345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.970711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.971086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] PATH_INFO: `/v3/users/318c9d22bd9c42809287dd837849c324` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.972424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=318c9d22bd9c42809287dd837849c324)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:13.974409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:14.028648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318c9d22bd9c42809287dd837849c324'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.037045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318c9d22bd9c42809287dd837849c324'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.037863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318c9d22bd9c42809287dd837849c324'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.046955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318c9d22bd9c42809287dd837849c324'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.064080 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-600cd4c0-5017-4804-9528-554e33962e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318c9d22bd9c42809287dd837849c324'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.072738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 995/2014] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:13 2022] DELETE /identity/v3/users/318c9d22bd9c42809287dd837849c324 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:14.509351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:14.511231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:14.545217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc659ef-c1a3-4eb2-b7af-f21821fa24b3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:14.606622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:14.663493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:14.665357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:14.666194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:14.666853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] PATH_INFO: `/v3/projects/0b970ecbb51d405f90d6104979a40d18` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:14.670040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b970ecbb51d405f90d6104979a40d18)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:14.673837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:14.774167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b970ecbb51d405f90d6104979a40d18', 'request_id': 'req-71df386f-ba42-4e8f-ab45-c938eef23617'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.790516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b970ecbb51d405f90d6104979a40d18', 'request_id': 'req-71df386f-ba42-4e8f-ab45-c938eef23617'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.807801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b970ecbb51d405f90d6104979a40d18', 'request_id': 'req-71df386f-ba42-4e8f-ab45-c938eef23617'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.870420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] The token cache is being invalidate because project 0b970ecbb51d405f90d6104979a40d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:14.871117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.873055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:14.876155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1020/2015] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:14 2022] DELETE /identity/v3/projects/0b970ecbb51d405f90d6104979a40d18 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:14.890107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960091-4e27-46dc-85ee-40c9f15bd9b0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:14.890107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960091-4e27-46dc-85ee-40c9f15bd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:14.890107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960091-4e27-46dc-85ee-40c9f15bd9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:14.905648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a960091-4e27-46dc-85ee-40c9f15bd9b0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:14.907207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a960091-4e27-46dc-85ee-40c9f15bd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:14.982147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:15.015226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.016954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.024490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 996/2016] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:15.027033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.028211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.029743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.040146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df386f-ba42-4e8f-ab45-c938eef23617 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.053694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.055954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.059251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.059574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] PATH_INFO: `/v3/users/57ca00cba4694f408960b7d70d70c681` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.061718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ca00cba4694f408960b7d70d70c681)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.065889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.077691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:15.081398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.100464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 997/2017] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:15.100464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.102361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.143724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65223e3-6712-4c3c-91aa-42057d020590 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.150317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.152459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.153299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.153776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] PATH_INFO: `/v3/users/4f117a205fd64cae9ca68003b27851c2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.161230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f117a205fd64cae9ca68003b27851c2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.163796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ca00cba4694f408960b7d70d70c681'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.164871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.179974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ca00cba4694f408960b7d70d70c681'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.180713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ca00cba4694f408960b7d70d70c681'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.191640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ca00cba4694f408960b7d70d70c681'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.192813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ca00cba4694f408960b7d70d70c681'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.249740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1021/2018] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:15 2022] DELETE /identity/v3/users/57ca00cba4694f408960b7d70d70c681 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:15.252135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.253997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.265081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f117a205fd64cae9ca68003b27851c2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.276926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f117a205fd64cae9ca68003b27851c2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.278976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f117a205fd64cae9ca68003b27851c2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.293700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f117a205fd64cae9ca68003b27851c2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.320656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f919aa29-b8f8-44be-b310-4190dbcae0c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f117a205fd64cae9ca68003b27851c2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:15.328774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:15.329843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 998/2019] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:15 2022] DELETE /identity/v3/users/4f117a205fd64cae9ca68003b27851c2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:15.343021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.343021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.343021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.366381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:15.367207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c7807-9707-4787-a2f9-e65f690fce7c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.368044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.449595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.450300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.450585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.450861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.451709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:15.452020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.453709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458cf38-564c-4b45-8c95-fbfc43f2fe37 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.466959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1022/2020] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:15.468569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.468863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.469147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.493438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:15.494553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.504000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1023/2021] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:15.504000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.505701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.519964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f240c79-f939-4a1e-ba6f-bf9912b505a3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.526104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.526456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.526624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.527012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.527832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.529879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.539393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 999/2022] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:15.545437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.547737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.573999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1024/2023] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:15 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:15.575535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.577683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:15.633524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2adc5-be86-4a13-b84e-89388ef86eb9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.638512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:15.662834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1d855-fc6a-4d53-a741-b29a66a7d538 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.674956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.676070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.676549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.677007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.713350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.714115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.714488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.714832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.787143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.790096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.797419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:15.803586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1025/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:15.804569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.814623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.814899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6675db6-0e51-4e30-9060-950f2ff98aa4 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.817947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.819814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.820511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.820787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.821058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.821755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.823799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.835500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1000/2025] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:15.852568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1026/2026] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:15 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:15.864074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.875852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ff244-4762-4a7c-8f7b-6b16a7fc395a service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.885098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.885844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.886133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.886543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.887636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.890679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.901954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1001/2027] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:15.906887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.923499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8e5d-4c43-449d-b5e3-ffc01175c9ef admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.931443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817df82-ef1b-4f89-8e74-d3009e71b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.931717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817df82-ef1b-4f89-8e74-d3009e71b482 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.931997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817df82-ef1b-4f89-8e74-d3009e71b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.932318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817df82-ef1b-4f89-8e74-d3009e71b482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:15.933254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817df82-ef1b-4f89-8e74-d3009e71b482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:15.935020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817df82-ef1b-4f89-8e74-d3009e71b482 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:15.951787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1027/2028] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:15.958634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:15.975010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b5888-756f-46fe-8c04-6d1332ee659f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:15.984108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:15.985357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:15.986180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:15.987177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] PATH_INFO: `/v3/projects/b5230bb806ac4877a1e6f22253637d6c/users/933fb2731ae44f4cb09432b87438a018/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:16.018814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5230bb806ac4877a1e6f22253637d6c, user_id=933fb2731ae44f4cb09432b87438a018, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:16.023964 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:16.050781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1002/2029] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:15 2022] PUT /identity/v3/projects/b5230bb806ac4877a1e6f22253637d6c/users/933fb2731ae44f4cb09432b87438a018/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:16.062508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:16.062964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:16.063414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:16.133297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] MFA Rules not processed for user `933fb2731ae44f4cb09432b87438a018`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:16.136954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:16.312513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1028/2030] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:16.418149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:16.420619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:16.509880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063697-1653-40bc-9bad-0418e59a8885 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:16.515676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:16.516649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:16.517674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:16.517959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:16.531580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:16.534188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:16.550909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1003/2031] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:16.580273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:16.714811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8264-dfb1-4954-ac52-f13cef237171 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:16.720198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:16.722078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:16.722530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:16.722977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] PATH_INFO: `/v3/users/933fb2731ae44f4cb09432b87438a018` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:16.724452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933fb2731ae44f4cb09432b87438a018)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:16.726622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:16.806231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:16.809075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:16.816117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933fb2731ae44f4cb09432b87438a018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:16.830785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933fb2731ae44f4cb09432b87438a018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:16.831510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933fb2731ae44f4cb09432b87438a018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:16.835209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815cc9e-ea1f-494a-91c9-3b065576a6ae service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:16.845787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933fb2731ae44f4cb09432b87438a018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:16.846532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933fb2731ae44f4cb09432b87438a018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:16.847686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:16.849362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:16.850322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:16.852915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] PATH_INFO: `/v3/projects/1a493bfc7a3144a4821f3dd80a62f282` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:16.853450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:16.856700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a493bfc7a3144a4821f3dd80a62f282)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:16.859819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:16.897507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1029/2032] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:16 2022] DELETE /identity/v3/users/933fb2731ae44f4cb09432b87438a018 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:16.898537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:16.906132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:16.928567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:17.017194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a493bfc7a3144a4821f3dd80a62f282', 'request_id': 'req-ffe36284-d5e0-4257-ade9-999928e1f426'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.024359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2590c0-b4a0-46da-8d15-208856177c15 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:17.028273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a493bfc7a3144a4821f3dd80a62f282', 'request_id': 'req-ffe36284-d5e0-4257-ade9-999928e1f426'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.044067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a493bfc7a3144a4821f3dd80a62f282', 'request_id': 'req-ffe36284-d5e0-4257-ade9-999928e1f426'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.062497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] The token cache is being invalidate because project 1a493bfc7a3144a4821f3dd80a62f282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:17.062799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.064183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ffe36284-d5e0-4257-ade9-999928e1f426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.066248 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1004/2033] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:16 2022] DELETE /identity/v3/projects/1a493bfc7a3144a4821f3dd80a62f282 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:17.067568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:17.067860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:17.068476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:17.090166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:17.092110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:17.112025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:17.113121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:17.113390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:17.113691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] PATH_INFO: `/v3/projects/75db49feda744aeea588f9fa77edd1c5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:17.115797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75db49feda744aeea588f9fa77edd1c5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:17.117024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:17.178979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1005/2034] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:17.180164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:17.181740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:17.183170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75db49feda744aeea588f9fa77edd1c5', 'request_id': 'req-e44491f6-0d28-417c-8874-64f0e1c0c440'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.194051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75db49feda744aeea588f9fa77edd1c5', 'request_id': 'req-e44491f6-0d28-417c-8874-64f0e1c0c440'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.204193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75db49feda744aeea588f9fa77edd1c5', 'request_id': 'req-e44491f6-0d28-417c-8874-64f0e1c0c440'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.207039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bda3f-ae10-40f3-bcab-1c12a42f01f3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:17.223735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] The token cache is being invalidate because project 75db49feda744aeea588f9fa77edd1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:17.224231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.226190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.230295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1030/2035] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:16 2022] DELETE /identity/v3/projects/75db49feda744aeea588f9fa77edd1c5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:17.233018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:17.237546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:17.278940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:17.302703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:17.303564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:17.303844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:17.304117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] PATH_INFO: `/v3/users/b81f2c8fc2fd4eb4a2f658984a3a8f8f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:17.305361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81f2c8fc2fd4eb4a2f658984a3a8f8f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:17.307389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:17.333489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44491f6-0d28-417c-8874-64f0e1c0c440 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:17.338055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:17.338722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:17.339018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:17.339304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:17.341238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:17.356051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:17.357953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:17.372233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1031/2036] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:17.373177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:17.374608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:17.390128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da875f-e0ee-4bed-b2d3-cb90a76a9c2b service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:17.398810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:17.400354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:17.400846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:17.401462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] PATH_INFO: `/v3/users/a690f8a87502490ab33f5367dcc4d999` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:17.404558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a690f8a87502490ab33f5367dcc4d999)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:17.405878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81f2c8fc2fd4eb4a2f658984a3a8f8f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.409067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:17.410703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:17.420457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81f2c8fc2fd4eb4a2f658984a3a8f8f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.431651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81f2c8fc2fd4eb4a2f658984a3a8f8f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.452999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81f2c8fc2fd4eb4a2f658984a3a8f8f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.496584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81f2c8fc2fd4eb4a2f658984a3a8f8f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.526963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1006/2037] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:17 2022] DELETE /identity/v3/users/b81f2c8fc2fd4eb4a2f658984a3a8f8f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:17.533564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a690f8a87502490ab33f5367dcc4d999'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.555725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a690f8a87502490ab33f5367dcc4d999'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.556470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a690f8a87502490ab33f5367dcc4d999'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.573449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a690f8a87502490ab33f5367dcc4d999'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.574487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a690f8a87502490ab33f5367dcc4d999'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:17.610315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1032/2038] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:17 2022] DELETE /identity/v3/users/a690f8a87502490ab33f5367dcc4d999 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:18.294175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:18.297749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:18.469785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19f771-3d9a-4fb0-afac-185280484ce0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:18.558577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:18.559860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:18.560265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:18.560714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] PATH_INFO: `/v3/projects/b5230bb806ac4877a1e6f22253637d6c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:18.562176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5230bb806ac4877a1e6f22253637d6c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:18.564586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:18.641245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5230bb806ac4877a1e6f22253637d6c', 'request_id': 'req-cfb203dd-da25-488e-b86c-bdb7e5f0a716'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.649457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5230bb806ac4877a1e6f22253637d6c', 'request_id': 'req-cfb203dd-da25-488e-b86c-bdb7e5f0a716'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.664480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5230bb806ac4877a1e6f22253637d6c', 'request_id': 'req-cfb203dd-da25-488e-b86c-bdb7e5f0a716'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.680048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:18.681637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:18.696160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] The token cache is being invalidate because project b5230bb806ac4877a1e6f22253637d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:18.696843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.698835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.705037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1007/2039] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:18 2022] DELETE /identity/v3/projects/b5230bb806ac4877a1e6f22253637d6c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:18.705037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:18.707371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:18.716491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:18.719375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70d4fe-b1a3-4949-aa87-9bd647e45a57 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:18.812135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:18.813203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:18.813528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:18.813875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] PATH_INFO: `/v3/projects/5fc0b5581fc840e99882148cb6704c20` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:18.815542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc0b5581fc840e99882148cb6704c20)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:18.817556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:18.835233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb203dd-da25-488e-b86c-bdb7e5f0a716 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:18.840543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:18.841435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:18.842254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:18.842254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] PATH_INFO: `/v3/projects/860eee3eb4294b40945aed2a18966e58` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:18.843475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=860eee3eb4294b40945aed2a18966e58)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:18.845527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:18.865326 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:18.890206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc0b5581fc840e99882148cb6704c20', 'request_id': 'req-c0482052-2f55-413b-bd13-ac5d07373a4f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.905056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc0b5581fc840e99882148cb6704c20', 'request_id': 'req-c0482052-2f55-413b-bd13-ac5d07373a4f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.913879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc0b5581fc840e99882148cb6704c20', 'request_id': 'req-c0482052-2f55-413b-bd13-ac5d07373a4f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.918748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860eee3eb4294b40945aed2a18966e58', 'request_id': 'req-19006fd7-a68b-4706-ae82-75e529edc47c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.927570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860eee3eb4294b40945aed2a18966e58', 'request_id': 'req-19006fd7-a68b-4706-ae82-75e529edc47c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.928512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] The token cache is being invalidate because project 5fc0b5581fc840e99882148cb6704c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:18.928810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.929503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c0482052-2f55-413b-bd13-ac5d07373a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.937022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1033/2040] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:18 2022] DELETE /identity/v3/projects/5fc0b5581fc840e99882148cb6704c20 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:18.937022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:18.937022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:18.937022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:18.955084 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860eee3eb4294b40945aed2a18966e58', 'request_id': 'req-19006fd7-a68b-4706-ae82-75e529edc47c'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.960793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:18.962123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:18.974104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] The token cache is being invalidate because project 860eee3eb4294b40945aed2a18966e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:18.974525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.975280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-19006fd7-a68b-4706-ae82-75e529edc47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:18.977876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1008/2041] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:18 2022] DELETE /identity/v3/projects/860eee3eb4294b40945aed2a18966e58 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:18.979575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594706f-4a54-411a-8f6f-b8cceacce315 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:18.979873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594706f-4a54-411a-8f6f-b8cceacce315 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:18.980152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594706f-4a54-411a-8f6f-b8cceacce315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.002055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b594706f-4a54-411a-8f6f-b8cceacce315 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:19.003385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b594706f-4a54-411a-8f6f-b8cceacce315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:19.051938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1034/2042] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:19.053580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.055946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:19.084587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411611-7340-4c90-964e-871a76844ce7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:19.099655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:19.100589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.100894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.101228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] PATH_INFO: `/v3/users/0df546769bf14f18ae4106fc0d4a434d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.108879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df546769bf14f18ae4106fc0d4a434d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:19.110347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:19.113525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1009/2043] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:19.117099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a791654-ff85-482e-bba4-6c676789ce65 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.117937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a791654-ff85-482e-bba4-6c676789ce65 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.118448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a791654-ff85-482e-bba4-6c676789ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.147568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8a791654-ff85-482e-bba4-6c676789ce65 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:19.150025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8a791654-ff85-482e-bba4-6c676789ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:19.190904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1010/2044] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:19.195236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.196385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.198214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.228499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df546769bf14f18ae4106fc0d4a434d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:19.243319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:19.249707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df546769bf14f18ae4106fc0d4a434d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:19.250616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df546769bf14f18ae4106fc0d4a434d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:19.255907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:19.263875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df546769bf14f18ae4106fc0d4a434d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:19.266453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df546769bf14f18ae4106fc0d4a434d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:19.303470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1011/2045] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:19.303470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.311606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:19.355381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1035/2046] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:19 2022] DELETE /identity/v3/users/0df546769bf14f18ae4106fc0d4a434d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:19.356978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.381332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb5cbb-205f-423b-bc1a-68d2729e79c9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:19.438493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:19.476531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:19.526563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705d27-3bda-46e8-b37b-f0f84cd05255 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:19.544528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:19.545506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.545797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.546073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.548456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:19.548456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:19.552116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:19.585672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1036/2047] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:19.586771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.608091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:19.612386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.613227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.618588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.620830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:19.621739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:19.625307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:19.625696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09fe7d-90dd-425c-bff4-7e06a44559f7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:19.640768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:19.645553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.647304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.647595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.652716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:19.662052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:19.682316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1012/2048] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:19.687423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.723846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf1283-6e9c-4651-982e-20802e15bb33 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:19.755207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1037/2049] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:19 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:19.756074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:19.756074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:19.756074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:19.756074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:19.756701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:19.768703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:19.769008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.890794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1013/2050] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:19 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:19.893765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:19.939036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040532ee-25fd-4e9a-90f9-9e2dcb74d4b1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.069471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.070202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.070471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.070745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.071495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.074308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.104906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1038/2051] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:19 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:20.106295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.109342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.125501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bae80-d6b0-4586-ad4d-9314b1c93bbf admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.129990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d067d-51db-4fa3-9529-bffd18ce5714 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.141385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.142579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.143162 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.143585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.144495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.147135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.153346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.154765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.155320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.155819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] PATH_INFO: `/v3/users/b136cff03dd24903ab6af799eb2e21a0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.158220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b136cff03dd24903ab6af799eb2e21a0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.162391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.207491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1014/2052] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:19 2022] POST /identity/v3/users => generated 288 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:20.208522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.235978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c3eaf-a970-452c-96cb-638cd3a107c9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.241380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.241739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:20.241948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.242373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.242660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.244145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.247314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.254261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b136cff03dd24903ab6af799eb2e21a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.264775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b136cff03dd24903ab6af799eb2e21a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.266041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b136cff03dd24903ab6af799eb2e21a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.266661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1015/2053] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:20.267670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.272492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.280565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b136cff03dd24903ab6af799eb2e21a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.281370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b136cff03dd24903ab6af799eb2e21a0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.297048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7879d-6a40-43fa-8cce-6c04aa9b3c1e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.302757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d418c4-b1e9-41c9-a77e-f84e19ef596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.303588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d418c4-b1e9-41c9-a77e-f84e19ef596b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.304154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d418c4-b1e9-41c9-a77e-f84e19ef596b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.304154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d418c4-b1e9-41c9-a77e-f84e19ef596b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.304854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d418c4-b1e9-41c9-a77e-f84e19ef596b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.306754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d418c4-b1e9-41c9-a77e-f84e19ef596b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.312179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1039/2054] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:20 2022] DELETE /identity/v3/users/b136cff03dd24903ab6af799eb2e21a0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:20.313440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.314850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.323648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1016/2055] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:20.326372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.327596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.328138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.354184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:20.355745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.427062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173136f3-e54c-4838-9c60-1d752ef212c9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.436826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.437626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.437918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.438672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.439734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.441602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.461530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1040/2056] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:20.462527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.485525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9037793-0630-4d5a-ba47-cc0d75f8d62d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.489372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1017/2057] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:20.490575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.492043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.496072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.496806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.497106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.497392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.499122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.500022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:20.500989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.509756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83daa86-35b3-4c50-bc47-88d92c414b01 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.516211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1041/2058] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:20.516211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.521890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.522823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.523322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.523655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] PATH_INFO: `/v3/projects/3119b608b8a245fcb0c28fbb51744582` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.529105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3119b608b8a245fcb0c28fbb51744582)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.529339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369ebd-ee73-438e-ae02-e5ac3d06af25 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.531590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.534826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.535772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.536134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.536410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] PATH_INFO: `/v3/projects/1e3dd34a8f734baabc3bcb1fc9088d90/users/e4c49f095e134f54bf93425830192d58/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.558517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3dd34a8f734baabc3bcb1fc9088d90, user_id=e4c49f095e134f54bf93425830192d58, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.562207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.578210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1042/2059] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:20 2022] PUT /identity/v3/projects/1e3dd34a8f734baabc3bcb1fc9088d90/users/e4c49f095e134f54bf93425830192d58/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:20.579170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.580800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.600933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3119b608b8a245fcb0c28fbb51744582', 'request_id': 'req-bb321b03-4ec1-43ff-9430-646df90f52e4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.606984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3119b608b8a245fcb0c28fbb51744582', 'request_id': 'req-bb321b03-4ec1-43ff-9430-646df90f52e4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.617025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3119b608b8a245fcb0c28fbb51744582', 'request_id': 'req-bb321b03-4ec1-43ff-9430-646df90f52e4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.630219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] The token cache is being invalidate because project 3119b608b8a245fcb0c28fbb51744582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:20.630427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.631201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:20.633066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1018/2060] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:20 2022] DELETE /identity/v3/projects/3119b608b8a245fcb0c28fbb51744582 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:20.633930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.635210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.646790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406eac6-b0a6-4309-8ed6-e05be9e53769 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.681962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:20.706142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.706900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.707079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.707366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.709432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.712850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321b03-4ec1-43ff-9430-646df90f52e4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.718661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ead93-d44a-4778-90ca-bc238845ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.719627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ead93-d44a-4778-90ca-bc238845ead4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.719904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ead93-d44a-4778-90ca-bc238845ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.720172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ead93-d44a-4778-90ca-bc238845ead4 admin admin] PATH_INFO: `/v3/projects/17b34987e176400496c9672a9377739e/users/030d1d265ab0481d8f62f02d48d36ca6/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.722320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.723884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23538a56-722e-4312-b777-e3a87e871a88 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.737081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1043/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:20.737632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ead93-d44a-4778-90ca-bc238845ead4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b34987e176400496c9672a9377739e, user_id=030d1d265ab0481d8f62f02d48d36ca6, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.739555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b895-7a64-4e41-81ad-5d82c5866a48 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.740030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b895-7a64-4e41-81ad-5d82c5866a48 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.740455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ead93-d44a-4778-90ca-bc238845ead4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.740617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b895-7a64-4e41-81ad-5d82c5866a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.758203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1019/2062] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:20 2022] PUT /identity/v3/projects/17b34987e176400496c9672a9377739e/users/030d1d265ab0481d8f62f02d48d36ca6/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:20.759784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524fc2-d9a5-40af-b027-17486a018eeb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.760068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524fc2-d9a5-40af-b027-17486a018eeb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.760351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524fc2-d9a5-40af-b027-17486a018eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.781581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3e524fc2-d9a5-40af-b027-17486a018eeb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:20.782739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3e524fc2-d9a5-40af-b027-17486a018eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.785018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8941b895-7a64-4e41-81ad-5d82c5866a48 None None] MFA Rules not processed for user `e4c49f095e134f54bf93425830192d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:20.786956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8941b895-7a64-4e41-81ad-5d82c5866a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.867167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1020/2063] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:20.868712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.869006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.869281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.882754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1044/2064] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:20.885615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.886107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.886532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.893358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:20.908021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] MFA Rules not processed for user `030d1d265ab0481d8f62f02d48d36ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:20.909210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.912201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:20.913558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.931410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1045/2065] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:20.932627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:20.934208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:20.947826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd504-ff10-4d48-95f4-9472499fb8c9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:20.953522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:20.954218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:20.954502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:20.954773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:20.955577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:20.957536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:20.996912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1046/2066] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:20 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:20.996912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.007037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1021/2067] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:21.007037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.019185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e29b5-5477-4edf-b152-c7ecdb6d7165 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.089783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44bc7-24b9-46ca-91f4-be77e4162fc2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.098068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.099853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.100299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.100686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.101940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:21.102317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.104489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.110598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.111538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.111946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.112335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.113153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.115396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.119293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1047/2068] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:21.120466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.133410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f10e95-5824-407f-a19a-61205123defc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.138969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.139875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.140168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.140537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.143085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1022/2069] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:21 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:21.143433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.144603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.144740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.146465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.158863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180212f-ada3-4ae0-9cc9-ec713ab4fea9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.163962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.164854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.165224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.165578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] PATH_INFO: `/v3/projects/f1cb1d284f514e108a4017d2743093b0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.166807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cb1d284f514e108a4017d2743093b0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.168767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.185649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1048/2070] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:21 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:21.186546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.198966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:21.239831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cb1d284f514e108a4017d2743093b0', 'request_id': 'req-8f58709a-52c0-4183-ad5c-f06142aee739'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.248684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cb1d284f514e108a4017d2743093b0', 'request_id': 'req-8f58709a-52c0-4183-ad5c-f06142aee739'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.260134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cb1d284f514e108a4017d2743093b0', 'request_id': 'req-8f58709a-52c0-4183-ad5c-f06142aee739'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.267969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d255-9b6a-43ff-967e-75e8d0cc83b3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.276223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] The token cache is being invalidate because project f1cb1d284f514e108a4017d2743093b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:21.276545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.277375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.278948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1023/2071] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:21 2022] DELETE /identity/v3/projects/f1cb1d284f514e108a4017d2743093b0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:21.279766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.281217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.297675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:21.334021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.335919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.335919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.335919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.338591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.338591 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.363463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58709a-52c0-4183-ad5c-f06142aee739 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.378524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.379333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.379556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.379822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.380622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.388784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.389438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1049/2072] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:21 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:21.393587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.397529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.407416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1024/2073] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:21.408297 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.412043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.426352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc3831-1787-4742-8800-cadd61f64f96 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.508238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15ab1-d7fe-4068-a33d-4e9e2ce55ac1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.512145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.513903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.514680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.515137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.515664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.516731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.517589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.517944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.518848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] PATH_INFO: `/v3/users/69ce49e55d2d42b7b36b790d5124a790` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.518970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.519846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ce49e55d2d42b7b36b790d5124a790)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.523081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.551966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1050/2074] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:21 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:21.557178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.560200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.575497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171078c-3ef4-43c0-ac71-66df5d75ea84 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.583627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.584787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.585148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.585505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.586629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.589928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.620480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1051/2075] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:21 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:21.621361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.634011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3982ea-51ab-420c-8249-57be32d4ef62 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.637599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ce49e55d2d42b7b36b790d5124a790'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.640907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.642319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.642816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.643268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.644166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.645983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.662211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ce49e55d2d42b7b36b790d5124a790'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.664101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ce49e55d2d42b7b36b790d5124a790'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.670854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1052/2076] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:21.672044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.674635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.677715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ce49e55d2d42b7b36b790d5124a790'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.685599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:21.696465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccbc34-04f3-43b8-8d28-4f96432c8e42 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.696938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ce49e55d2d42b7b36b790d5124a790'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:21.703215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.704014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.704369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.704750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.705571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.707545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.711189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1025/2077] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:21 2022] DELETE /identity/v3/users/69ce49e55d2d42b7b36b790d5124a790 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:21.711189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.711189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.719264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1053/2078] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:21.723948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.726358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.752164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25f9b-a83d-4518-933d-d81d9f28ff33 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.753217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:21.801651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d4431-1b70-4535-856a-dd6fc4468d9a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.807181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.807935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.808190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.808457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.809308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.811888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.831258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1026/2079] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:21.833552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.839755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.840752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.841035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.841332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] PATH_INFO: `/v3/projects/7466036b09cd473c92e87d1de44040a7/users/dd1e6eefad014c819c81e6b40e78de59/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.853352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344d401-3e69-4fa2-844c-827f5c2bf23d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:21.859465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c782a-4bfd-4d29-ae63-4193a2e6c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:21.860803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c782a-4bfd-4d29-ae63-4193a2e6c553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.861089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c782a-4bfd-4d29-ae63-4193a2e6c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.861366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c782a-4bfd-4d29-ae63-4193a2e6c553 admin admin] PATH_INFO: `/v3/projects/ecc75db1ed524e5880749fd20ee58c4e/users/8aab8f6b213d471d97d8243461716784/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.864638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7466036b09cd473c92e87d1de44040a7, user_id=dd1e6eefad014c819c81e6b40e78de59, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.868061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.881758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c782a-4bfd-4d29-ae63-4193a2e6c553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc75db1ed524e5880749fd20ee58c4e, user_id=8aab8f6b213d471d97d8243461716784, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:21.885268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c782a-4bfd-4d29-ae63-4193a2e6c553 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:21.894598 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1054/2080] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:21 2022] PUT /identity/v3/projects/7466036b09cd473c92e87d1de44040a7/users/dd1e6eefad014c819c81e6b40e78de59/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:21.895901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:21.919071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1027/2081] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:21 2022] PUT /identity/v3/projects/ecc75db1ed524e5880749fd20ee58c4e/users/8aab8f6b213d471d97d8243461716784/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:21.922218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:21.922523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:21.922797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:21.954025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] MFA Rules not processed for user `dd1e6eefad014c819c81e6b40e78de59`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:21.955251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:21.991901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a059-307f-4a52-92fb-4723c13a0431 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.047177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1028/2082] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:22.048631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.071552 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.072256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.072870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.073161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.073915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.075722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.088375 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1055/2083] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:22.089377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.100372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80e16-f4ad-4ca2-b10d-37ef89109098 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.105646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.106320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.106602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.106878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.107645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.109577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.124916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:22.128476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb6d41-ed77-4748-8efc-bb7824b9bb7a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.134090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.134782 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.135103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.135382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.136193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.137791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.141180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1056/2084] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:22.141970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.146153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.149624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1029/2085] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:22.150654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.164953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a310ab-0729-43ec-a45b-94b55ff6ebfa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.188930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:22.217204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f733213-7659-47db-b5f0-fbb19b10ac06 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.221908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.222794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.223118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.223564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] PATH_INFO: `/v3/projects/b871ae47b5af4326a18f569d20c5df28` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.225123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b871ae47b5af4326a18f569d20c5df28)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.227582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.229800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.230794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.231091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.231416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] PATH_INFO: `/v3/projects/6cc23c46fee64787b4027f9e2a15b84f/users/a66894033afd4d97a55de2a06e208d0c/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.248864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc23c46fee64787b4027f9e2a15b84f, user_id=a66894033afd4d97a55de2a06e208d0c, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.251597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.268413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1030/2086] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:22 2022] PUT /identity/v3/projects/6cc23c46fee64787b4027f9e2a15b84f/users/a66894033afd4d97a55de2a06e208d0c/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:22.280374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.283215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b871ae47b5af4326a18f569d20c5df28', 'request_id': 'req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:22.299415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b871ae47b5af4326a18f569d20c5df28', 'request_id': 'req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:22.305745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b871ae47b5af4326a18f569d20c5df28', 'request_id': 'req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:22.323131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] The token cache is being invalidate because project b871ae47b5af4326a18f569d20c5df28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:22.323424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:22.324196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:22.326289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1057/2087] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:22 2022] DELETE /identity/v3/projects/b871ae47b5af4326a18f569d20c5df28 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:22.327101 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.329448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.361158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41ea7-cb63-4756-96c7-c66d02c8ea54 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.419409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dc9fe-9d71-411c-99ac-25f90f5d33b7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.425863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86b48a-37ed-4407-b8ec-8140cbe5f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.426838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b48a-37ed-4407-b8ec-8140cbe5f7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.427160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b48a-37ed-4407-b8ec-8140cbe5f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.427439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b48a-37ed-4407-b8ec-8140cbe5f7f2 admin admin] PATH_INFO: `/v3/projects/ecc75db1ed524e5880749fd20ee58c4e/users/8aab8f6b213d471d97d8243461716784/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.429871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86b48a-37ed-4407-b8ec-8140cbe5f7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc75db1ed524e5880749fd20ee58c4e, user_id=8aab8f6b213d471d97d8243461716784, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.433454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86b48a-37ed-4407-b8ec-8140cbe5f7f2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.434602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52d630-f715-4d6d-9834-6e5aed30707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.435326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d630-f715-4d6d-9834-6e5aed30707d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.435882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d630-f715-4d6d-9834-6e5aed30707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.436211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52d630-f715-4d6d-9834-6e5aed30707d admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.436986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52d630-f715-4d6d-9834-6e5aed30707d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.438948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52d630-f715-4d6d-9834-6e5aed30707d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.455123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1058/2088] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:22 2022] PUT /identity/v3/projects/ecc75db1ed524e5880749fd20ee58c4e/users/8aab8f6b213d471d97d8243461716784/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:22.456750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.457043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.457323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.478312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1031/2089] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:22.481138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc05ae-4bfd-47d4-9ee8-649fa26c2347 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.483092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc05ae-4bfd-47d4-9ee8-649fa26c2347 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.483092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc05ae-4bfd-47d4-9ee8-649fa26c2347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.497637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] MFA Rules not processed for user `a66894033afd4d97a55de2a06e208d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:22.499790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.505307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8ecc05ae-4bfd-47d4-9ee8-649fa26c2347 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:22.506856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8ecc05ae-4bfd-47d4-9ee8-649fa26c2347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.514544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:22.566708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:22.600244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1032/2090] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:22.600244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.600244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.600244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.600662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1059/2091] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:22.600662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.601309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.623445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0edd4-bae2-47de-8fb1-125ed2ceb023 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.630941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.631841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.632162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.632447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.633338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.636233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.636402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] MFA Rules not processed for user `8aab8f6b213d471d97d8243461716784`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:22.636491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.655606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1060/2092] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:22.656933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.659107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.674747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e69c9-5209-4bee-9e7d-e7b03919d06e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.688765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a7c09-4df4-430a-816e-b82322b6d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.690195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7c09-4df4-430a-816e-b82322b6d2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.690638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7c09-4df4-430a-816e-b82322b6d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.690967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a7c09-4df4-430a-816e-b82322b6d2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.691978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a7c09-4df4-430a-816e-b82322b6d2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.695055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a7c09-4df4-430a-816e-b82322b6d2f1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.739523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1061/2093] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:22.741224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.741683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.743051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.760386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1033/2094] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:22.763420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.767939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:22.769231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.782698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c492535-2a09-4bff-bb93-fd2558c5e0de None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.891234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1062/2095] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:22.891234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.891825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.891825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.891825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.891825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] PATH_INFO: `/v3/projects/b966025b97b94f74bf1548f9a9ea72d4/users/419526c55f0c4c14813b7462ac1776a0/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.901938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea712-cbc0-4d9f-aac4-2eaa55a9f639 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:22.912959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b966025b97b94f74bf1548f9a9ea72d4, user_id=419526c55f0c4c14813b7462ac1776a0, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.913666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:22.916112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:22.916287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.916789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:22.917606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:22.921650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:22.926224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:22.953044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1034/2096] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:22 2022] PUT /identity/v3/projects/b966025b97b94f74bf1548f9a9ea72d4/users/419526c55f0c4c14813b7462ac1776a0/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:22.954206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:22.970100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:22.992975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1063/2097] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:22 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:22.992975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.006354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8507f1-1c59-4503-b4ba-4a32086944a8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.060022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dfcbb-ab61-4666-ad81-c982641553e3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.065849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.066550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.067120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.067279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.069985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:23.084697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.091328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.092846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.092846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.092846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.093689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:23.094069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.096226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.098613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.113257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1064/2098] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:23.114165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.126123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a9a2-68e6-42ab-aa90-039dfafeccb0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.131583 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.132418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.132637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.132975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.133750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.135521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.147818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1065/2099] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:23.147818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.159047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2ac6-be23-451a-a58b-9cb9feadb21b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.165890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.166584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.166695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.166870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.167195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.167941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.168889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.169567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.180838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1035/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:23.182140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.193645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1066/2101] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:23.195319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.199812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7848-3259-474b-8633-578002268ba2 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.206640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6a5f-7408-4bda-9f1e-2c6bef621feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.207439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6a5f-7408-4bda-9f1e-2c6bef621feb admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.207727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6a5f-7408-4bda-9f1e-2c6bef621feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.208004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6a5f-7408-4bda-9f1e-2c6bef621feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.208733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a6a5f-7408-4bda-9f1e-2c6bef621feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.210870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a6a5f-7408-4bda-9f1e-2c6bef621feb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.211712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcf5ff-0bb7-4cff-81ed-cd40d3b1d7ff admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.219279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.220364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.220738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.221585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] PATH_INFO: `/v3/projects/b966025b97b94f74bf1548f9a9ea72d4/users/419526c55f0c4c14813b7462ac1776a0/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.235801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b966025b97b94f74bf1548f9a9ea72d4, user_id=419526c55f0c4c14813b7462ac1776a0, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.238781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.259974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1067/2102] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:23 2022] PUT /identity/v3/projects/b966025b97b94f74bf1548f9a9ea72d4/users/419526c55f0c4c14813b7462ac1776a0/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:23.261528 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.288408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1036/2103] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:23.290501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.292428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.294422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.401074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] MFA Rules not processed for user `419526c55f0c4c14813b7462ac1776a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:23.402579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:23.428295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448df31f-9b4c-49ac-8932-4cc1cbb6e186 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.532245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1037/2104] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:23.534354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.560573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.561474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.562192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.562967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.564990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.567587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.580449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1068/2105] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:23.585963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.602206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbdeb2-6a5b-411a-982f-1b8e02391153 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.608279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.610752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.611382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.611581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] PATH_INFO: `/v3/projects/dd58e4a01bbd445ca275a5dd3b202f5e/users/3f73a77259664cefa0d651287b508784/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.650070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd58e4a01bbd445ca275a5dd3b202f5e, user_id=3f73a77259664cefa0d651287b508784, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.658693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.690414 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d751767-c96c-45de-b1d6-a79e66a245f4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.697791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1069/2106] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:23 2022] PUT /identity/v3/projects/dd58e4a01bbd445ca275a5dd3b202f5e/users/3f73a77259664cefa0d651287b508784/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:23.699711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:23.743711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.814948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.838093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0fb0-0f16-4685-b13a-3cecfaf7217d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:23.842453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eef426-4a37-4ca2-8566-d407a9bb8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.843424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef426-4a37-4ca2-8566-d407a9bb8621 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.843876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef426-4a37-4ca2-8566-d407a9bb8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.844258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eef426-4a37-4ca2-8566-d407a9bb8621 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.845358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:23.845510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eef426-4a37-4ca2-8566-d407a9bb8621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.846480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.846956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.847454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.847825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eef426-4a37-4ca2-8566-d407a9bb8621 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.850313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:23.882497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1038/2107] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:23 2022] POST /identity/v3/users => generated 287 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:23.886203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:23.886768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:23.887316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:23.938030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] MFA Rules not processed for user `3f73a77259664cefa0d651287b508784`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:23.939717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:23.961290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:23.963071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:23.975367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1070/2108] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:23.976968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.003855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63308a8f-7fd6-4335-a22b-e3a92339e419 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.023835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.024697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.024989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.025412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.026166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.028021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.051041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1071/2109] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:24.055640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.071250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1039/2110] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:24.072428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.082657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84be0a-975d-4a36-b76c-95635cd2bdbf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.088570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443b811-6651-4927-8a0a-90ecda259716 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.098616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.099342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.099620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.099891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.100648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.101801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.102554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.102673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.102889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.103224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.105422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.111686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.141769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1072/2111] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:24.142900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.162852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1040/2112] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:24 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:24.165584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea31a1-c12a-4e93-895d-2104d7ed503a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.168144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.322221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293dc3-7978-4741-bb05-7fc13974c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.323561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293dc3-7978-4741-bb05-7fc13974c675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.324188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293dc3-7978-4741-bb05-7fc13974c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.324699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293dc3-7978-4741-bb05-7fc13974c675 admin admin] PATH_INFO: `/v3/projects/c34f0701cdb845dc9ab0d4572bf8ae79/users/2ad2692a15d54bffa6b8cd90c0ffd72a/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.332914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75fb9e-dfea-442d-a9f2-ce1ea25eb266 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.348626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.349552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.349978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.350581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.351681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.352209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293dc3-7978-4741-bb05-7fc13974c675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34f0701cdb845dc9ab0d4572bf8ae79, user_id=2ad2692a15d54bffa6b8cd90c0ffd72a, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.354736 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.355242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293dc3-7978-4741-bb05-7fc13974c675 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.383427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1073/2113] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:24 2022] PUT /identity/v3/projects/c34f0701cdb845dc9ab0d4572bf8ae79/users/2ad2692a15d54bffa6b8cd90c0ffd72a/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:24.385074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.385667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.386106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.393783 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1041/2114] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:24 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:24.397878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.406564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:24.416384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989bb6-a24b-419d-9257-b6d17928135b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.443650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:24.445083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:24.490411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.490942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.491281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.491597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.492351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.494307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.506005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1042/2115] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:24.510696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.523119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f39c8-4bed-410d-bb96-011a2d3516ef admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.529008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.529663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.529952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.530219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] PATH_INFO: `/v3/projects/253a410e3e024548b1b337d2334d9792/users/8704591f33cc4d83b722fd920e9e1cbd/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.556450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253a410e3e024548b1b337d2334d9792, user_id=8704591f33cc4d83b722fd920e9e1cbd, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.560068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.604697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1043/2116] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:24 2022] PUT /identity/v3/projects/253a410e3e024548b1b337d2334d9792/users/8704591f33cc4d83b722fd920e9e1cbd/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:24.608330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.612233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:24.629064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1074/2117] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:24.645680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.647418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:24.691283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65f17c-163e-4a8c-8119-0a7a10e1fe81 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.696955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.697652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.697930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.698202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.698935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.700894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.713370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1044/2118] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:24.717874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:24.722193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab24c-9f56-4439-b77c-911a784907cb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.731115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3615d0-717c-4b8a-ba66-03e58bb4dcb4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:24.736354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6f369-639b-4512-9978-f9796f5b614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.737511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6f369-639b-4512-9978-f9796f5b614c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.737826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6f369-639b-4512-9978-f9796f5b614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.738163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6f369-639b-4512-9978-f9796f5b614c admin admin] PATH_INFO: `/v3/projects/253a410e3e024548b1b337d2334d9792/users/8704591f33cc4d83b722fd920e9e1cbd/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.740634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6f369-639b-4512-9978-f9796f5b614c admin admin] RBAC: Authorizing `identity:create_grant(project_id=253a410e3e024548b1b337d2334d9792, user_id=8704591f33cc4d83b722fd920e9e1cbd, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.743518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6f369-639b-4512-9978-f9796f5b614c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.760823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1045/2119] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:24 2022] PUT /identity/v3/projects/253a410e3e024548b1b337d2334d9792/users/8704591f33cc4d83b722fd920e9e1cbd/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:24.771690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.772101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.772476 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.793563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:24.794413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:24.794691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:24.795067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:24.805531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:24.807124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:24.817159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1075/2120] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:24.819331 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] MFA Rules not processed for user `8704591f33cc4d83b722fd920e9e1cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:24.821370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:24.902620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:24.931417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1046/2121] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:24.944243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:25.015172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484edd52-76fd-4e2a-aa45-f44065f0e663 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:25.086533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c6a46-eee8-454f-bc08-cb8006db25da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:25.087239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c6a46-eee8-454f-bc08-cb8006db25da service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:25.087520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c6a46-eee8-454f-bc08-cb8006db25da service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:25.088131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c6a46-eee8-454f-bc08-cb8006db25da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:25.100875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c6a46-eee8-454f-bc08-cb8006db25da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:25.102381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c6a46-eee8-454f-bc08-cb8006db25da service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:25.113763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1076/2122] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:25.161408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:25.162936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:25.179491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a28dd-9230-4743-8b1d-000936c5de1f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:25.185902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:25.186571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:25.186897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:25.187206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:25.284105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:25.286190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:25.301287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1047/2123] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:25.704927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:25.705902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:25.705902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:25.728980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:25.741013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] MFA Rules not processed for user `2ad2692a15d54bffa6b8cd90c0ffd72a`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:25.742335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:25.874114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1077/2124] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:25.878947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:25.998063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454158-eb79-4615-a904-7dfdde5b9922 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.003117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.003874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.004335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.004620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.005505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.007712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.014717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.029933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9eef4-3952-4c0b-a7fc-4090aba309d2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.043884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.045026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.045410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.045751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] PATH_INFO: `/v3/users/030d1d265ab0481d8f62f02d48d36ca6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.046262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1048/2125] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:26.047582 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030d1d265ab0481d8f62f02d48d36ca6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.049693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.052001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.113190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030d1d265ab0481d8f62f02d48d36ca6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:26.124400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030d1d265ab0481d8f62f02d48d36ca6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:26.125418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030d1d265ab0481d8f62f02d48d36ca6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:26.131029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342e803-2f4e-43f1-aad0-2701f6c71aa5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.134742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030d1d265ab0481d8f62f02d48d36ca6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:26.135639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030d1d265ab0481d8f62f02d48d36ca6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:26.137036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb839c-74b8-463a-8d90-4a351877f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.137770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb839c-74b8-463a-8d90-4a351877f7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.138423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb839c-74b8-463a-8d90-4a351877f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.138856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb839c-74b8-463a-8d90-4a351877f7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.139620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb839c-74b8-463a-8d90-4a351877f7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.141580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb839c-74b8-463a-8d90-4a351877f7b8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.157962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:26.158341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1078/2126] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:26 2022] DELETE /identity/v3/users/030d1d265ab0481d8f62f02d48d36ca6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:26.159201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.160621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:26.166837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1049/2127] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:26 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:26.168257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.168609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.169406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.190587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:26.192072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:26.237255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3119a-f806-433b-97cb-281405516072 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.241712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.242379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.242806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.243137 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.245347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:26.258547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1050/2128] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:26.259341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.260975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:26.277182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea2f6-6f7a-4a4a-b866-d50908878ea3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.280490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:26.285922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.286725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.287217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.287496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.288227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.289877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.305838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1051/2129] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:26.306764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.310007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:26.319920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.321450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.331687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1079/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:26.332444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.344104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a1dcc-9964-4124-9f2c-fc75e2476129 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.352875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.354228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.354419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.354790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] PATH_INFO: `/v3/projects/4f11d4e6db3f4655a974f522af26fc23/users/47d5a8c165444be083ea53ac8e0350cd/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.388507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db8480-0204-46a3-9e1a-19f5e90144f2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.390087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f11d4e6db3f4655a974f522af26fc23, user_id=47d5a8c165444be083ea53ac8e0350cd, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.393187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.393743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.394326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.394610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.394881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.409596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.411401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.413816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1080/2131] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:26 2022] PUT /identity/v3/projects/4f11d4e6db3f4655a974f522af26fc23/users/47d5a8c165444be083ea53ac8e0350cd/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:26.418762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.426183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1052/2132] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:26.507092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d30cf1-196a-424c-834e-675007d7d7c3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.513707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.514536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.514717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.515016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.515784 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.517516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.532128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1081/2133] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:26.533582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.545579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630f5ad-44a4-431f-93ed-7189244cbcd8 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:26.551999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:26.553048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:26.554012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:26.554397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] PATH_INFO: `/v3/projects/4f11d4e6db3f4655a974f522af26fc23/users/47d5a8c165444be083ea53ac8e0350cd/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:26.557878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f11d4e6db3f4655a974f522af26fc23, user_id=47d5a8c165444be083ea53ac8e0350cd, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:26.561728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:26.575947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1053/2134] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:26 2022] PUT /identity/v3/projects/4f11d4e6db3f4655a974f522af26fc23/users/47d5a8c165444be083ea53ac8e0350cd/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:26.841581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:26.844651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:26.892733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0cd0-bd4f-46a9-b51d-d30c3a8b8567 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:27.039571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:27.040616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:27.040763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:27.040985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] PATH_INFO: `/v3/projects/17b34987e176400496c9672a9377739e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:27.042421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b34987e176400496c9672a9377739e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:27.045502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:27.050081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:27.052238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.078921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11ff28-841d-414e-9aea-8d9160cc5a04 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:27.093941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:27.095258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:27.095550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:27.095885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] PATH_INFO: `/v3/users/3103332aa1ff49a7ba75220421dbf44e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:27.098085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3103332aa1ff49a7ba75220421dbf44e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:27.101348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:27.110979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:27.136870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b34987e176400496c9672a9377739e', 'request_id': 'req-0193a31c-38dc-4c01-ac18-4cc8091763ac'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.155790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b34987e176400496c9672a9377739e', 'request_id': 'req-0193a31c-38dc-4c01-ac18-4cc8091763ac'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.177697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b34987e176400496c9672a9377739e', 'request_id': 'req-0193a31c-38dc-4c01-ac18-4cc8091763ac'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.198465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] The token cache is being invalidate because project 17b34987e176400496c9672a9377739e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:27.198853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.200062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.202169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1082/2135] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:26 2022] DELETE /identity/v3/projects/17b34987e176400496c9672a9377739e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:27.208906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:27.210755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.217924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3103332aa1ff49a7ba75220421dbf44e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.230938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3103332aa1ff49a7ba75220421dbf44e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.232211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3103332aa1ff49a7ba75220421dbf44e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.270500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3103332aa1ff49a7ba75220421dbf44e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.300357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:27.310961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3103332aa1ff49a7ba75220421dbf44e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.326073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1054/2136] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:27 2022] DELETE /identity/v3/users/3103332aa1ff49a7ba75220421dbf44e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:27.327555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:27.332628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.357386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193a31c-38dc-4c01-ac18-4cc8091763ac admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:27.475219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c286a7-b980-4030-a6a2-b1bacc9d32bd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:27.483849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:27.484534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:27.484816 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:27.486325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:27.489936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.518441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:27.519407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:27.519780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:27.519981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] PATH_INFO: `/v3/users/8aab8f6b213d471d97d8243461716784` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:27.521594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aab8f6b213d471d97d8243461716784)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:27.524097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:27.609961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aab8f6b213d471d97d8243461716784'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.627336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aab8f6b213d471d97d8243461716784'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.628272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aab8f6b213d471d97d8243461716784'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.643831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:27.647466 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3379a6f-b313-40bd-b10d-c3e587895c93 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:27.648198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aab8f6b213d471d97d8243461716784'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.649195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3989ae85-8752-4e92-95a0-93c887d424fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aab8f6b213d471d97d8243461716784'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:27.678054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1055/2137] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:27.682455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:27.685338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:27.686721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:27.689763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:27.717553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1083/2138] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:27 2022] DELETE /identity/v3/users/8aab8f6b213d471d97d8243461716784 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:27.740245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:27.742418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.837386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1056/2139] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:27.864646 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:27.865810 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:27.866563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:27.866855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:27.867634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.959309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] MFA Rules not processed for user `47d5a8c165444be083ea53ac8e0350cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:27.963174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:27.974249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:28.041453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe433a3-b0b4-47e6-b6c0-12ebd02386c0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:28.046300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa6cbc-da31-41de-a1fc-3375378d48b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:28.048058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6cbc-da31-41de-a1fc-3375378d48b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:28.048359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6cbc-da31-41de-a1fc-3375378d48b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:28.048643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6cbc-da31-41de-a1fc-3375378d48b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:28.072417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa6cbc-da31-41de-a1fc-3375378d48b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:28.076452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa6cbc-da31-41de-a1fc-3375378d48b1 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:28.106549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1057/2140] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:28.259574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1084/2141] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:28.271770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:28.272158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:28.272441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:28.292148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] MFA Rules not processed for user `2ad2692a15d54bffa6b8cd90c0ffd72a`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:28.293383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:28.378412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1058/2142] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:28.391252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:28.392940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:28.503559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069d38c-511b-461b-b68a-5b899ce11c9b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:28.514630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:28.515693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:28.516366 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:28.516808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:28.520426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:28.534421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:28.536694 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:28.553353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1085/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:28.667516 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:28.669003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:28.690589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fdc0-cd10-4d7b-bde6-2fe0741f73d3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:28.695912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:28.696989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:28.697362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:28.697730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] PATH_INFO: `/v3/projects/ecc75db1ed524e5880749fd20ee58c4e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:28.699633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc75db1ed524e5880749fd20ee58c4e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:28.702018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:28.784719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc75db1ed524e5880749fd20ee58c4e', 'request_id': 'req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:28.792128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc75db1ed524e5880749fd20ee58c4e', 'request_id': 'req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:28.804492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc75db1ed524e5880749fd20ee58c4e', 'request_id': 'req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:28.824160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] The token cache is being invalidate because project ecc75db1ed524e5880749fd20ee58c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:28.824855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:28.826078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e1fe0a56-fe29-4e04-9d21-ea9a676eb101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:28.828241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1059/2144] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:28 2022] DELETE /identity/v3/projects/ecc75db1ed524e5880749fd20ee58c4e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:28.922872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:28.924414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:28.947180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a5713-5936-4415-885c-05b65bc03ee7 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:29.032562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:29.034163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:29.034660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:29.035558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] PATH_INFO: `/v3/users/a66894033afd4d97a55de2a06e208d0c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:29.037271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66894033afd4d97a55de2a06e208d0c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:29.040094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:29.048048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:29.102539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66894033afd4d97a55de2a06e208d0c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.112445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66894033afd4d97a55de2a06e208d0c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.113778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66894033afd4d97a55de2a06e208d0c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.128524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66894033afd4d97a55de2a06e208d0c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.130075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66894033afd4d97a55de2a06e208d0c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.178274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1086/2145] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:28 2022] DELETE /identity/v3/users/a66894033afd4d97a55de2a06e208d0c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:29.184360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:29.187484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:29.188295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:29.214173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:29.226796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:29.352775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1060/2146] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:29.364007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:29.365632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:29.412669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:29.415156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:29.436557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37c653-cf62-4e91-88eb-29a710438b5c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:29.445035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:29.445951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:29.446239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:29.446767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] PATH_INFO: `/v3/projects/92227c3f9afd4170ac451b7a3d94fc6b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:29.448367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=92227c3f9afd4170ac451b7a3d94fc6b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:29.450534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:29.460812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:29.462046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf3980-59e0-4a7d-ae69-08f1a87578b9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:29.470621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:29.471455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:29.472004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:29.487393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:29.514131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:29.515676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:29.533560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1087/2147] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:29.556192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92227c3f9afd4170ac451b7a3d94fc6b', 'request_id': 'req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.564889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92227c3f9afd4170ac451b7a3d94fc6b', 'request_id': 'req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.581064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92227c3f9afd4170ac451b7a3d94fc6b', 'request_id': 'req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.600558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] The token cache is being invalidate because project 92227c3f9afd4170ac451b7a3d94fc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:29.600728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.601421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.603509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1061/2148] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:29 2022] DELETE /identity/v3/projects/92227c3f9afd4170ac451b7a3d94fc6b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:29.609381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:29.621893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7b6e-db9b-408e-9577-0d7972bb1699 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:29.764909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:29.766894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:29.767267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:29.767634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] PATH_INFO: `/v3/users/d5e3d3eb3ebe4a9ab2c077515a818925` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:29.771119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e3d3eb3ebe4a9ab2c077515a818925)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:29.772699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:29.830228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:29.849803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e3d3eb3ebe4a9ab2c077515a818925'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.861124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e3d3eb3ebe4a9ab2c077515a818925'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.862537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e3d3eb3ebe4a9ab2c077515a818925'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.888725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e3d3eb3ebe4a9ab2c077515a818925'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.889630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e3d3eb3ebe4a9ab2c077515a818925'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:29.914668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1088/2149] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:29 2022] DELETE /identity/v3/users/d5e3d3eb3ebe4a9ab2c077515a818925 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:30.195940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:30.199101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:30.215759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f51f4-6995-4c1b-9d06-2fce1a7e7cfb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:30.440431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:30.442290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:30.443461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:30.461010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] PATH_INFO: `/v3/projects/6cc23c46fee64787b4027f9e2a15b84f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:30.461890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:30.463396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:30.467450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc23c46fee64787b4027f9e2a15b84f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:30.478754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:30.484721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ac179-046a-4189-8cb5-3b0dbc5d2a5f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:30.498786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:30.499731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:30.499998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:30.500269 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] PATH_INFO: `/v3/projects/507c67e2394e476a9a4ddcbdd49e36e2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:30.510378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507c67e2394e476a9a4ddcbdd49e36e2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:30.519834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:30.616357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc23c46fee64787b4027f9e2a15b84f', 'request_id': 'req-77e57032-e2b8-48bd-967d-5716f7dd8268'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.629132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507c67e2394e476a9a4ddcbdd49e36e2', 'request_id': 'req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.638764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc23c46fee64787b4027f9e2a15b84f', 'request_id': 'req-77e57032-e2b8-48bd-967d-5716f7dd8268'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.652813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507c67e2394e476a9a4ddcbdd49e36e2', 'request_id': 'req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.654761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc23c46fee64787b4027f9e2a15b84f', 'request_id': 'req-77e57032-e2b8-48bd-967d-5716f7dd8268'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.671971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507c67e2394e476a9a4ddcbdd49e36e2', 'request_id': 'req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.686346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] The token cache is being invalidate because project 6cc23c46fee64787b4027f9e2a15b84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:30.686346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.687580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.690136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1062/2150] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:30 2022] DELETE /identity/v3/projects/6cc23c46fee64787b4027f9e2a15b84f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:30.694773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:30.696373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:30.699454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] The token cache is being invalidate because project 507c67e2394e476a9a4ddcbdd49e36e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:30.701660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.704555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7565bf93-8b14-4a1f-b9c4-4c086ceadb58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:30.709870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1089/2151] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:30 2022] DELETE /identity/v3/projects/507c67e2394e476a9a4ddcbdd49e36e2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:30.715560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4757205-c1dc-4c0b-831c-270c0fd134fc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:30.715951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4757205-c1dc-4c0b-831c-270c0fd134fc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:30.716318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4757205-c1dc-4c0b-831c-270c0fd134fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:30.746900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d4757205-c1dc-4c0b-831c-270c0fd134fc None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:30.748313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d4757205-c1dc-4c0b-831c-270c0fd134fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:30.794226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:30.888627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57032-e2b8-48bd-967d-5716f7dd8268 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:30.893222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1090/2152] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:30.906247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:30.906536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:30.906870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:30.911661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:30.913597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:30.914165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:30.915878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] PATH_INFO: `/v3/users/3f73a77259664cefa0d651287b508784` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:30.917979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f73a77259664cefa0d651287b508784)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:30.921667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:30.959401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:30.962146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:30.978479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1091/2153] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:30.984754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.006087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bb1e8-2440-4425-9861-fda4af8588d9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.022841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.024344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.024344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.024763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.025720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:31.027847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.029717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.053803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f73a77259664cefa0d651287b508784'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.074491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1092/2154] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:31.076103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f73a77259664cefa0d651287b508784'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.076834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.077223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f73a77259664cefa0d651287b508784'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.080927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:31.105157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f73a77259664cefa0d651287b508784'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.125128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384776-a764-4630-8677-2c4495aa0fa9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.128578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f73a77259664cefa0d651287b508784'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.137686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.140322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.141443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.142511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1063/2155] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:30 2022] DELETE /identity/v3/users/3f73a77259664cefa0d651287b508784 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:31.143882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.145943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.173447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.216315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:31.275278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1093/2156] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:31 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:31.276959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.424150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390490c-1b8a-4bf9-bd1e-7b671d162fe0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.497668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:31.514774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.516890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.518941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.519273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.520889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.526136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.553592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1064/2157] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:31 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:31.554801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.567954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c8d7-786a-4977-b1b5-abc287778d74 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.579941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.580882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.581169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.581449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.582536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.584216 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.602033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1094/2158] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:31.603025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.617704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29429a1-d7c5-4a40-9e41-3f5ee03ce184 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.625115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.626404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.626911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.627549 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.628690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.631130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.650458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.656759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1065/2159] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:31.663620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba71f1-0844-4707-a075-22dc245c07f5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.687688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dcf61-9c81-4eed-8985-725db718c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.689555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcf61-9c81-4eed-8985-725db718c00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.689832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcf61-9c81-4eed-8985-725db718c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.690902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dcf61-9c81-4eed-8985-725db718c00d admin admin] PATH_INFO: `/v3/projects/2f804452ae6647a8b7672f3e0bf85e21/users/687e2bf6b14f43d18099bbdb7c9a1db5/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.725686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dcf61-9c81-4eed-8985-725db718c00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f804452ae6647a8b7672f3e0bf85e21, user_id=687e2bf6b14f43d18099bbdb7c9a1db5, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.727869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.734886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:31.746445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dcf61-9c81-4eed-8985-725db718c00d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.757118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacf3f5-5c3e-4aa1-b5c7-77a766fe8b34 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:31.775298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:31.776205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.776485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.776762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] PATH_INFO: `/v3/projects/dd58e4a01bbd445ca275a5dd3b202f5e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.779155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1095/2160] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:31 2022] PUT /identity/v3/projects/2f804452ae6647a8b7672f3e0bf85e21/users/687e2bf6b14f43d18099bbdb7c9a1db5/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:31.790079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd58e4a01bbd445ca275a5dd3b202f5e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:31.792177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:31.795616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:31.795900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:31.796173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:31.857502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] MFA Rules not processed for user `687e2bf6b14f43d18099bbdb7c9a1db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:31.862067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:31.917878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd58e4a01bbd445ca275a5dd3b202f5e', 'request_id': 'req-f3afc818-93ff-40e6-a50c-a943bc3782f0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.935558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd58e4a01bbd445ca275a5dd3b202f5e', 'request_id': 'req-f3afc818-93ff-40e6-a50c-a943bc3782f0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.944620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd58e4a01bbd445ca275a5dd3b202f5e', 'request_id': 'req-f3afc818-93ff-40e6-a50c-a943bc3782f0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.966276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] The token cache is being invalidate because project dd58e4a01bbd445ca275a5dd3b202f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:31.967728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.968459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:31.976320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1066/2161] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:31 2022] DELETE /identity/v3/projects/dd58e4a01bbd445ca275a5dd3b202f5e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:31.977493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:31.980701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.004035 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1096/2162] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:32.006923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.010059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.074847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc818-93ff-40e6-a50c-a943bc3782f0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.080370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.081982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.081982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.082321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] PATH_INFO: `/v3/users/8704591f33cc4d83b722fd920e9e1cbd` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.083741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8704591f33cc4d83b722fd920e9e1cbd)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.085756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.143667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809605f-3cde-4ed7-afc7-094b40eeabd1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.150674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.151455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.151964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.152297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.153090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.155385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.178180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8704591f33cc4d83b722fd920e9e1cbd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.197941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8704591f33cc4d83b722fd920e9e1cbd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.204245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8704591f33cc4d83b722fd920e9e1cbd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.204476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1097/2163] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:32 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:32.205076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:32.206295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.214115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.220444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8704591f33cc4d83b722fd920e9e1cbd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.253211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8704591f33cc4d83b722fd920e9e1cbd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.268628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:32.280644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1067/2164] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:31 2022] DELETE /identity/v3/users/8704591f33cc4d83b722fd920e9e1cbd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:32.280644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.281798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.355467 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0f6c-5fde-4a2a-a5f5-bd6dc7eeec98 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.457326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bee3b-4176-409b-a821-dda09d3e6207 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.463391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.484272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.484790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.485299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] PATH_INFO: `/v3/users/e4c49f095e134f54bf93425830192d58` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.490377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c49f095e134f54bf93425830192d58)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.492877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.530299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.532097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.532550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.533283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.533794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.536090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.566026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1098/2165] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:32 2022] POST /identity/v3/users => generated 297 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:32.571401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.587458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90f96-81db-407e-833a-5e499c0b92f9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.595682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.596802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.597202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.597572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.598478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.601233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.606225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c49f095e134f54bf93425830192d58'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.626140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c49f095e134f54bf93425830192d58'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.626952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c49f095e134f54bf93425830192d58'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.627990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1099/2166] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:32.632640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.636135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.646600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c49f095e134f54bf93425830192d58'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.659610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc6f2-edd7-45ce-a60b-4781549c60a5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.665586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.666938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.667347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.668075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] PATH_INFO: `/v3/projects/5b33064ccb5345c29bf8cf60b16c5111/users/4fb0f51fd03f40b79b1a73d3ccd378b6/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.683346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-3568de8b-ad20-4579-b7f8-4bc70e3fed3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c49f095e134f54bf93425830192d58'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:32.686845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b33064ccb5345c29bf8cf60b16c5111, user_id=4fb0f51fd03f40b79b1a73d3ccd378b6, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.689806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.701620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1068/2167] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:32 2022] DELETE /identity/v3/users/e4c49f095e134f54bf93425830192d58 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:32.706889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.707445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.707721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.718478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1100/2168] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:32 2022] PUT /identity/v3/projects/5b33064ccb5345c29bf8cf60b16c5111/users/4fb0f51fd03f40b79b1a73d3ccd378b6/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:32.720040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.751048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:32.752336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.873730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385316a-3774-4d4a-8a14-499c84507084 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.881319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.883313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.883313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.883690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.884987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.887207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.891874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:32.919432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1101/2169] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:32.921438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.924142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:32.928019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1069/2170] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:32.928019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.947323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d5375-8757-4b35-b252-f2549a355b5c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.950577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb9da-5f6d-4e9e-9502-a66cdadef35e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:32.956024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.957353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:32.958152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.958745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.959098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:32.959407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] PATH_INFO: `/v3/projects/5b33064ccb5345c29bf8cf60b16c5111/users/4fb0f51fd03f40b79b1a73d3ccd378b6/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.959571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:32.960167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] PATH_INFO: `/v3/projects/253a410e3e024548b1b337d2334d9792` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:32.962759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253a410e3e024548b1b337d2334d9792)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.964285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b33064ccb5345c29bf8cf60b16c5111, user_id=4fb0f51fd03f40b79b1a73d3ccd378b6, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:32.967327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.968698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:32.989923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1070/2171] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:32 2022] PUT /identity/v3/projects/5b33064ccb5345c29bf8cf60b16c5111/users/4fb0f51fd03f40b79b1a73d3ccd378b6/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:32.991269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:32.993527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:33.009577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:33.084741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253a410e3e024548b1b337d2334d9792', 'request_id': 'req-d2ced5ce-a256-4069-91e8-8f5aedfef062'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:33.108191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253a410e3e024548b1b337d2334d9792', 'request_id': 'req-d2ced5ce-a256-4069-91e8-8f5aedfef062'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:33.119015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253a410e3e024548b1b337d2334d9792', 'request_id': 'req-d2ced5ce-a256-4069-91e8-8f5aedfef062'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:33.130196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c42418-3543-42d3-881d-b272279964ed admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.141964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] The token cache is being invalidate because project 253a410e3e024548b1b337d2334d9792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:33.142409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:33.143364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ced5ce-a256-4069-91e8-8f5aedfef062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:33.145673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1102/2172] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:32 2022] DELETE /identity/v3/projects/253a410e3e024548b1b337d2334d9792 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:33.148313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343032-0075-40f3-9b39-ad9de5ef7342 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.148785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343032-0075-40f3-9b39-ad9de5ef7342 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.149082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343032-0075-40f3-9b39-ad9de5ef7342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.187265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2e343032-0075-40f3-9b39-ad9de5ef7342 None None] MFA Rules not processed for user `4fb0f51fd03f40b79b1a73d3ccd378b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:33.188794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2e343032-0075-40f3-9b39-ad9de5ef7342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:33.233087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.233778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.234063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.234344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.242833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:33.346943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.349263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.365043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1071/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:33.371816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1103/2174] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:33.371816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757b93-7df4-461d-959b-b03d1536d6ee None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.371816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757b93-7df4-461d-959b-b03d1536d6ee None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.371816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757b93-7df4-461d-959b-b03d1536d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.403766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:33.406762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:33.466265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a3757b93-7df4-461d-959b-b03d1536d6ee None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:33.469256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a3757b93-7df4-461d-959b-b03d1536d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:33.492084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1104/2175] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:33.494217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.494615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.495387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.508525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:33.521653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:33.523551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:33.529954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e593-0b6d-441b-84b8-872466783141 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.534333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.535137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.535327 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.535603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.540491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1105/2176] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:33.541886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:33.548030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.549729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.565984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd07b6-181e-46cd-8959-b29f3d196c0f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.573501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.574196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1072/2177] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:33.574627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.574977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.575374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.576280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:33.576703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.578908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.598466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1106/2178] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:33.599649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:33.612432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9edcb-4188-48d8-ab06-9d4d2f5b1161 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.620158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.621871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.622436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.622709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.624177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.628879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.679299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:33.679932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1073/2179] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:33 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:33.715354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3cb16-10ef-4323-a5f5-d06838b334f1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.846670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.847789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.848077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.848352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.849084 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.851604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.871612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:33.889341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:33.903430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1107/2180] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:33 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:33.917073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab909-6c4e-4f14-850c-8dd25bd1c057 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.925939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.926969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.927349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.927817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.929039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.931442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.953886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:33.955072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1074/2181] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:33.968986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cb57c-14ab-4c5c-b242-925f67134ed0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:33.974712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:33.975446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:33.975733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:33.976012 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:33.977062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:33.978644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:33.999019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1108/2182] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:34.001077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.016223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696e3bd-1967-4fb1-979a-3e311074156c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.023405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457362c-dbc1-4990-bab4-0982b3c5052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.024537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457362c-dbc1-4990-bab4-0982b3c5052d admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.024825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457362c-dbc1-4990-bab4-0982b3c5052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.025158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457362c-dbc1-4990-bab4-0982b3c5052d admin admin] PATH_INFO: `/v3/projects/a194654aaa8f4238a7a0bdc84352cec1/users/28ff5803b68a4a4d8916d36d86578d46/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.028435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.031887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.064746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2631-82d4-42c6-993f-9ebed088a484 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.069887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457362c-dbc1-4990-bab4-0982b3c5052d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a194654aaa8f4238a7a0bdc84352cec1, user_id=28ff5803b68a4a4d8916d36d86578d46, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.073787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457362c-dbc1-4990-bab4-0982b3c5052d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.079809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.080747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.081048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.081350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] PATH_INFO: `/v3/projects/1e3dd34a8f734baabc3bcb1fc9088d90` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.086079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3dd34a8f734baabc3bcb1fc9088d90)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.091121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.095814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1075/2183] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:33 2022] PUT /identity/v3/projects/a194654aaa8f4238a7a0bdc84352cec1/users/28ff5803b68a4a4d8916d36d86578d46/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:34.111858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.112154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.112438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.151561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] MFA Rules not processed for user `28ff5803b68a4a4d8916d36d86578d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:34.153093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.159067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3dd34a8f734baabc3bcb1fc9088d90', 'request_id': 'req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.169050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3dd34a8f734baabc3bcb1fc9088d90', 'request_id': 'req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.177147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3dd34a8f734baabc3bcb1fc9088d90', 'request_id': 'req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.191530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] The token cache is being invalidate because project 1e3dd34a8f734baabc3bcb1fc9088d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:34.191920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.192708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.194625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1109/2184] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:34 2022] DELETE /identity/v3/projects/1e3dd34a8f734baabc3bcb1fc9088d90 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:34.198119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.199574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.248051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1076/2185] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:34.253578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.260240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.307452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52c2fb-b60e-437f-96f3-96e77b9b7a7c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.317134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb0f51fd03f40b79b1a73d3ccd378b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b33064ccb5345c29bf8cf60b16c5111', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.318173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.318501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.318783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.320215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:34.320215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.321859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.342171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1110/2186] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:34.342171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.342171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.358949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c70dc0-adeb-42c2-9d0c-35433938bc95 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.364296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.365204 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.365487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.365708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] PATH_INFO: `/v3/users/dd1e6eefad014c819c81e6b40e78de59` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.368047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1e6eefad014c819c81e6b40e78de59)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.373231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.411527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:34.447373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:34.458625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1e6eefad014c819c81e6b40e78de59'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.467862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51437de-2e73-4184-93fc-56d84b5a33ca tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.476394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.478903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.479551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.479779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1e6eefad014c819c81e6b40e78de59'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.480326 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.480725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1e6eefad014c819c81e6b40e78de59'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.483444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.494947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1e6eefad014c819c81e6b40e78de59'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.505974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.509200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.524780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1111/2187] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:34.525463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.527409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.550759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f4a0f3b6-ec27-4598-9b23-532f831cf8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1e6eefad014c819c81e6b40e78de59'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:34.551713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c94f0-3bcf-42e1-990b-c3e7f6dde358 service glance] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.557193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb0f51fd03f40b79b1a73d3ccd378b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b33064ccb5345c29bf8cf60b16c5111', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.558076 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.558736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.559254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.560559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.563649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.591379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1077/2188] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:34 2022] DELETE /identity/v3/users/dd1e6eefad014c819c81e6b40e78de59 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:34.593444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcb48d-3734-4306-b420-cd94a80aac8b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.593729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcb48d-3734-4306-b420-cd94a80aac8b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.595225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcb48d-3734-4306-b420-cd94a80aac8b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.596879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1078/2189] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:39:34.599307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcb48d-3734-4306-b420-cd94a80aac8b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.604304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-69bcb48d-3734-4306-b420-cd94a80aac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.622266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1112/2190] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:34 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:34.627729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.714972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03e221-41f1-4ca8-94fb-aaf5e982f695 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.726654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb0f51fd03f40b79b1a73d3ccd378b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b33064ccb5345c29bf8cf60b16c5111', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.728718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.729406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.733907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.734879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:34.735314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.737241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b32a3-dc4b-487d-b872-9b18fb209a2c tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.768092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1113/2191] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:34.769630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.770019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.770392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.799884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] MFA Rules not processed for user `aac86cfdd00a43678c8506217f83ecdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:34.801315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:34.806582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcb48d-3734-4306-b420-cd94a80aac8b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.922204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1114/2192] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:39:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:34.923286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:34.953748 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4b716-500c-4326-bfaf-48fff329ea5e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:34.961189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fb0f51fd03f40b79b1a73d3ccd378b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b33064ccb5345c29bf8cf60b16c5111', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.962252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.962545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.962985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] PATH_INFO: `/v3/projects/ff6d8af9b8ff422cbe5e5059d2644edf` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.965157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff6d8af9b8ff422cbe5e5059d2644edf)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.968091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:34.979864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:34.980934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:34.982081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:34.982480 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] PATH_INFO: `/v3/users/c2e2a3ec4d0a43479b487e5faaf9a233` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:34.984845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e2a3ec4d0a43479b487e5faaf9a233)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:34.988401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:35.045828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6d8af9b8ff422cbe5e5059d2644edf', 'request_id': 'req-32991bf6-8539-4a14-95ac-eb34d9b50f93'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.048039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:35.056641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6d8af9b8ff422cbe5e5059d2644edf', 'request_id': 'req-32991bf6-8539-4a14-95ac-eb34d9b50f93'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.070500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6d8af9b8ff422cbe5e5059d2644edf', 'request_id': 'req-32991bf6-8539-4a14-95ac-eb34d9b50f93'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.090518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] The token cache is being invalidate because project ff6d8af9b8ff422cbe5e5059d2644edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:35.093320 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.094383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.100887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1115/2193] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:34 2022] DELETE /identity/v3/projects/ff6d8af9b8ff422cbe5e5059d2644edf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:35.103232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:35.106023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:35.143984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e2a3ec4d0a43479b487e5faaf9a233'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.147766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:35.167239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e2a3ec4d0a43479b487e5faaf9a233'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.168238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e2a3ec4d0a43479b487e5faaf9a233'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.197197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e2a3ec4d0a43479b487e5faaf9a233'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.237402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e2a3ec4d0a43479b487e5faaf9a233'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.262215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1079/2194] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:34 2022] DELETE /identity/v3/users/c2e2a3ec4d0a43479b487e5faaf9a233 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:35.355201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32991bf6-8539-4a14-95ac-eb34d9b50f93 tempest-VolumeQuotaClassesTest-1593171659 tempest-VolumeQuotaClassesTest-1593171659-project-admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:35.416753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:35.418317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:35.504433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:35.506644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:35.506941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:35.507249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:35.514469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:35.555475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:35.562936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:35.600863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1116/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:35.660328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:35.661797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:35.672437 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85a692-139b-43e7-9ec7-5e85dc1e8afc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:35.692086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:35.692995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:35.693295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:35.693572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] PATH_INFO: `/v3/projects/7466036b09cd473c92e87d1de44040a7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:35.696066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c3dd-fbd3-43d5-8667-fef46a5e046e service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:35.697031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7466036b09cd473c92e87d1de44040a7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:35.708672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:35.709781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:35.710837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:35.711161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:35.715126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] PATH_INFO: `/v3/users/687e2bf6b14f43d18099bbdb7c9a1db5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:35.715126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687e2bf6b14f43d18099bbdb7c9a1db5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:35.715126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:35.804695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687e2bf6b14f43d18099bbdb7c9a1db5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.813850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7466036b09cd473c92e87d1de44040a7', 'request_id': 'req-926963bb-1ca7-4d4d-9fd0-822847576020'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.818544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687e2bf6b14f43d18099bbdb7c9a1db5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.820901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687e2bf6b14f43d18099bbdb7c9a1db5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.826472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7466036b09cd473c92e87d1de44040a7', 'request_id': 'req-926963bb-1ca7-4d4d-9fd0-822847576020'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.843830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687e2bf6b14f43d18099bbdb7c9a1db5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.845121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dca7ca16-adbf-47c4-afd0-905ac97d9563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687e2bf6b14f43d18099bbdb7c9a1db5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.845242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7466036b09cd473c92e87d1de44040a7', 'request_id': 'req-926963bb-1ca7-4d4d-9fd0-822847576020'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.857171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:35.893886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1117/2196] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:35 2022] DELETE /identity/v3/users/687e2bf6b14f43d18099bbdb7c9a1db5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:35.908571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] The token cache is being invalidate because project 7466036b09cd473c92e87d1de44040a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:35.908978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.912733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:35.913147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:35.913648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:35.915711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:35.918575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1080/2197] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:35 2022] DELETE /identity/v3/projects/7466036b09cd473c92e87d1de44040a7 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:35.922948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:35.925578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:35.946037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:35.947497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.031263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:36.039344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926963bb-1ca7-4d4d-9fd0-822847576020 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.081951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1118/2198] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:36.081951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.083670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.098302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a16915-bd87-4ccf-9430-01ec3532ee34 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.104133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.105105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.105586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.105927 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] PATH_INFO: `/v3/projects/1bfc0d0018b0476a99193b24c90f775f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.107924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfc0d0018b0476a99193b24c90f775f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.110380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.125345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.126892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.127430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.127918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] PATH_INFO: `/v3/users/419526c55f0c4c14813b7462ac1776a0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.130091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419526c55f0c4c14813b7462ac1776a0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.133668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.189055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfc0d0018b0476a99193b24c90f775f', 'request_id': 'req-9c060479-e10e-413d-9a63-f53bd8ce4260'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.207049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfc0d0018b0476a99193b24c90f775f', 'request_id': 'req-9c060479-e10e-413d-9a63-f53bd8ce4260'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.220647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419526c55f0c4c14813b7462ac1776a0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.232508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfc0d0018b0476a99193b24c90f775f', 'request_id': 'req-9c060479-e10e-413d-9a63-f53bd8ce4260'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.235827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419526c55f0c4c14813b7462ac1776a0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.237669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419526c55f0c4c14813b7462ac1776a0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.247914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419526c55f0c4c14813b7462ac1776a0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.255082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] The token cache is being invalidate because project 1bfc0d0018b0476a99193b24c90f775f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:36.255530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.256627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.258803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1119/2199] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:36 2022] DELETE /identity/v3/projects/1bfc0d0018b0476a99193b24c90f775f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:36.260227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.262470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.279924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cbee632b-1552-4ad4-b79a-b0557780e5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419526c55f0c4c14813b7462ac1776a0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.289262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1081/2200] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:35 2022] DELETE /identity/v3/users/419526c55f0c4c14813b7462ac1776a0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:36.294386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed00975-f2f3-4199-b026-dddb2b07957e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.294386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed00975-f2f3-4199-b026-dddb2b07957e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.294386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed00975-f2f3-4199-b026-dddb2b07957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.312911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1ed00975-f2f3-4199-b026-dddb2b07957e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:36.314254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1ed00975-f2f3-4199-b026-dddb2b07957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.392135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c060479-e10e-413d-9a63-f53bd8ce4260 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.420840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1082/2201] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:36.430935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.431750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.431750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.441432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:36.476729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:36.478226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.497517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.498247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.498744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.498899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1083/2202] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:36.499087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.500931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.502661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.514027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe5fd8-fa20-417a-bc9f-22058e92f741 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.516956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.517909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.520177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.520988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.521358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.521725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.522550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:36.522951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.525361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.529963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1120/2203] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:36.552822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1084/2204] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:39:36.560199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.576905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ef8c-27ac-40a2-b017-5b1c068dd408 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.584382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.585164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.585452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.585719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.586433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.588569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.634102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1121/2205] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:36 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:36.639889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.646151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:36.662091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125591ce-7859-4e3f-8e80-77c96347d305 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.775444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.776665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.776665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.776950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.777443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.779584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.806064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1085/2206] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:36 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:36.810444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.823395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56f35-d78e-4f2e-a9d2-f6c645d7244a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.833093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.833956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.834252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.834555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.836221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.837984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.855532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1122/2207] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:36.859813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.867298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.870027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:36.872836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a483d-74e1-40f0-aeba-92d4b2c7f2a1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.889590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.890372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.890733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.891108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.891931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.892877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1a750-aece-4f89-a3ca-e183b36b86d9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.894608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.898509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.899667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.900010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.900345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] PATH_INFO: `/v3/projects/b966025b97b94f74bf1548f9a9ea72d4` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.902152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b966025b97b94f74bf1548f9a9ea72d4)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.904525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.908066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1086/2208] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:36.913258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:36.931502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5deec2-f052-41e6-bdd9-c35cf000f8e6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:36.938596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:36.940314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:36.940710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:36.941110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] PATH_INFO: `/v3/projects/691d65199bba4c63b78ceaa2ad6dcf5f/users/b4de631c92ac409f8e907807f54e516e/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:36.970304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=691d65199bba4c63b78ceaa2ad6dcf5f, user_id=b4de631c92ac409f8e907807f54e516e, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:36.979576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:36.987573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b966025b97b94f74bf1548f9a9ea72d4', 'request_id': 'req-1a5c1856-694c-499d-8fb5-eda92eb34ec9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:36.998879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b966025b97b94f74bf1548f9a9ea72d4', 'request_id': 'req-1a5c1856-694c-499d-8fb5-eda92eb34ec9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.008568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b966025b97b94f74bf1548f9a9ea72d4', 'request_id': 'req-1a5c1856-694c-499d-8fb5-eda92eb34ec9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.013376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1087/2209] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:36 2022] PUT /identity/v3/projects/691d65199bba4c63b78ceaa2ad6dcf5f/users/b4de631c92ac409f8e907807f54e516e/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:37.014471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.018171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.025895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] The token cache is being invalidate because project b966025b97b94f74bf1548f9a9ea72d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:37.026372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.027199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1a5c1856-694c-499d-8fb5-eda92eb34ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.029655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1123/2210] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:36 2022] DELETE /identity/v3/projects/b966025b97b94f74bf1548f9a9ea72d4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:37.031633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e061a-9d73-4e77-9768-f9706e6c6c4d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.032069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e061a-9d73-4e77-9768-f9706e6c6c4d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.032400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e061a-9d73-4e77-9768-f9706e6c6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.064392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5d4e061a-9d73-4e77-9768-f9706e6c6c4d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:37.066089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5d4e061a-9d73-4e77-9768-f9706e6c6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.109075 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fa6c4-cdf2-401b-ace9-bae66460f3aa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.116594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.117658 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.117786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.118009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] PATH_INFO: `/v3/projects/2f804452ae6647a8b7672f3e0bf85e21` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.119269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f804452ae6647a8b7672f3e0bf85e21)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.121219 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.158887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1124/2211] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:37.160513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.162532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.162532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.181931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:37.183371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.194238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f804452ae6647a8b7672f3e0bf85e21', 'request_id': 'req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.195989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:37.200264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f804452ae6647a8b7672f3e0bf85e21', 'request_id': 'req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.202647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:37.212128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f804452ae6647a8b7672f3e0bf85e21', 'request_id': 'req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.233178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] The token cache is being invalidate because project 2f804452ae6647a8b7672f3e0bf85e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:37.233464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.234343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.236475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1088/2212] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:37 2022] DELETE /identity/v3/projects/2f804452ae6647a8b7672f3e0bf85e21 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:37.237312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.239683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.262461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1125/2213] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:37.264862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.267454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.288107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325331a-ca49-4643-98ee-c9567384e6d2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.295438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.296850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.297303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.297761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] PATH_INFO: `/v3/users/4fb0f51fd03f40b79b1a73d3ccd378b6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.299050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb0f51fd03f40b79b1a73d3ccd378b6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.301031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.315144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acbb0-92b1-4e98-9b9a-2d2d3773f006 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.320499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.321363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.321651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.321929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.324129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.340400 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.342447 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5d063-e0db-45d3-b065-6c8d57ced5fb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.365942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1089/2214] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:37.367523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.367870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.368261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.371047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb0f51fd03f40b79b1a73d3ccd378b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.385584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb0f51fd03f40b79b1a73d3ccd378b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.386246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb0f51fd03f40b79b1a73d3ccd378b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.399213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb0f51fd03f40b79b1a73d3ccd378b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.400222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb0f51fd03f40b79b1a73d3ccd378b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:37.402018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:37.403497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:37.413261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1090/2215] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:37.417321 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.426849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd952e0b-18b2-478d-93b3-6db31774ac52 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.430569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1126/2216] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:37 2022] DELETE /identity/v3/users/4fb0f51fd03f40b79b1a73d3ccd378b6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:37.511931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.513469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.513976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.514392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.515399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:37.515925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.518058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.535449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1091/2217] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:39:37.542696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.560123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6c071-1fcb-4cf5-96d3-e51b5806737a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.569013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.569942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.570285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.570570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.571849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.574688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.605783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1127/2218] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:37 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:37.610908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.627442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f36739-800a-4f8f-b735-5f0e9e716b7f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.713541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.714408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.714890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.716358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.716848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.719530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.762111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1092/2219] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:37 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:37.770272 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.807715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114ece-7398-4dcf-8aa9-0f1e5eb98ceb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.820420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.821093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.821830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.822018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.822778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.824614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.841327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1128/2220] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:37.845760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.859448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82a9c-12d5-4eb3-b978-8b03acbc97e9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.866325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2995f01-5046-43b6-97bd-36ed7ea7462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.867379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995f01-5046-43b6-97bd-36ed7ea7462a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.867885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995f01-5046-43b6-97bd-36ed7ea7462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.868860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2995f01-5046-43b6-97bd-36ed7ea7462a admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.879207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2995f01-5046-43b6-97bd-36ed7ea7462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.882023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2995f01-5046-43b6-97bd-36ed7ea7462a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.884031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:37.911287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1093/2221] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:37.915955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:37.927685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93010d7c-1f29-47bd-992c-522910c6e6b1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:37.933350 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:37.934249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.934532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.934798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] PATH_INFO: `/v3/projects/a840ad63cfbe4a98a2f9ee27c954d8e0/users/b443981a52c2468ab6ec7a16ee8c2c84/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:37.962917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a840ad63cfbe4a98a2f9ee27c954d8e0, user_id=b443981a52c2468ab6ec7a16ee8c2c84, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:37.969434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:37.985414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1129/2222] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:37 2022] PUT /identity/v3/projects/a840ad63cfbe4a98a2f9ee27c954d8e0/users/b443981a52c2468ab6ec7a16ee8c2c84/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:37.998169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:37.998451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:37.998716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.035256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] MFA Rules not processed for user `b443981a52c2468ab6ec7a16ee8c2c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:38.036623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:38.081908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:38.083958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:38.161929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1094/2223] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:38.169173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:38.174052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:38.176216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:38.249274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cbea7-ce10-4469-aec7-5ef2bb5667ee admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:38.258325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:38.259625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.259926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.260306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] PATH_INFO: `/v3/projects/5b33064ccb5345c29bf8cf60b16c5111` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.262415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b33064ccb5345c29bf8cf60b16c5111)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:38.265251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:38.280553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26287ae-bd5e-4043-9959-ff6b15c6a808 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:38.287061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f31384-4c42-4eb3-9a68-2f8e255500e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:38.288164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f31384-4c42-4eb3-9a68-2f8e255500e0 service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.289440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f31384-4c42-4eb3-9a68-2f8e255500e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.289827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f31384-4c42-4eb3-9a68-2f8e255500e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.304120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f31384-4c42-4eb3-9a68-2f8e255500e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:38.305995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f31384-4c42-4eb3-9a68-2f8e255500e0 service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:38.322570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1095/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:38.351722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b33064ccb5345c29bf8cf60b16c5111', 'request_id': 'req-3e399f66-b649-4271-ab41-ba06ed06fefd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:38.392415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b33064ccb5345c29bf8cf60b16c5111', 'request_id': 'req-3e399f66-b649-4271-ab41-ba06ed06fefd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:38.407869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b33064ccb5345c29bf8cf60b16c5111', 'request_id': 'req-3e399f66-b649-4271-ab41-ba06ed06fefd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:38.438735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] The token cache is being invalidate because project 5b33064ccb5345c29bf8cf60b16c5111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:38.439271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:38.440379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3e399f66-b649-4271-ab41-ba06ed06fefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:38.443424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1130/2225] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:38 2022] DELETE /identity/v3/projects/5b33064ccb5345c29bf8cf60b16c5111 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:38.450374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.451157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.451157 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.481698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:38.481698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:38.571525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1096/2226] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:38.577199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.577697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.578116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.612413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:38.616049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:38.630985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1131/2227] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:38.632258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:38.645139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761187e-f523-482f-ac1c-ecc812116164 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:38.653420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:38.654579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.654955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.655332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.659856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:38.660281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:38.665634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:38.686041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1097/2228] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:38.691222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:38.701588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0222910-5ef4-451d-8c03-ceb7b696e51e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:38.708732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:38.710153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.710686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.711166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.712418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:38.714901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:38.752089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1132/2229] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:38 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:38.757131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:38.783234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9fd1c-692e-4a3c-a930-fa0e5bfc5dcb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:38.806911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:38.920684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:38.921829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:38.922511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:38.922511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:38.923988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:38.926563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:38.961029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1098/2230] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:38 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:38.967442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:39.001309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc1672-0d0b-410b-88e6-149564ea32fb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:39.006919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:39.007790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:39.008069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:39.008348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:39.019772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:39.021630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:39.055528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:39.066494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1133/2231] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:39.086392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448a4bf-89fd-418a-a6c1-3e127c151b95 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:39.109436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3cfa9-13d6-4664-8e79-ad6faadd1a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:39.110191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3cfa9-13d6-4664-8e79-ad6faadd1a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:39.110419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3cfa9-13d6-4664-8e79-ad6faadd1a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:39.110737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3cfa9-13d6-4664-8e79-ad6faadd1a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:39.111762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3cfa9-13d6-4664-8e79-ad6faadd1a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:39.113314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3cfa9-13d6-4664-8e79-ad6faadd1a74 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:39.135620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1099/2232] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:39.141159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:39.153537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0419de0-e02c-4dda-b54f-504989b44665 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:39.158836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:39.159795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:39.160134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:39.160466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] PATH_INFO: `/v3/projects/5649be8cb0fb46d49ece200c88edcabb/users/78704e75433349b3b9c156acfd12b74d/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:39.183213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5649be8cb0fb46d49ece200c88edcabb, user_id=78704e75433349b3b9c156acfd12b74d, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:39.186753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:39.211379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1134/2233] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:39 2022] PUT /identity/v3/projects/5649be8cb0fb46d49ece200c88edcabb/users/78704e75433349b3b9c156acfd12b74d/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:39.219104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:39.219498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:39.219867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:39.258839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] MFA Rules not processed for user `78704e75433349b3b9c156acfd12b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:39.261311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:39.412402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1100/2234] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:39.430147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:39.430147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:39.539347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154a324-220d-4bf7-8c59-9dc3c8340aed admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:39.544493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1a30d-3d77-45dd-8bca-519c3abc593e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:39.545453 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1a30d-3d77-45dd-8bca-519c3abc593e service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:39.545743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1a30d-3d77-45dd-8bca-519c3abc593e service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:39.546025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1a30d-3d77-45dd-8bca-519c3abc593e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:39.558787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1a30d-3d77-45dd-8bca-519c3abc593e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:39.561048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1a30d-3d77-45dd-8bca-519c3abc593e service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:39.572235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:39.590931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1135/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:39.617758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:39.831395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32360-0a2f-4feb-b9fd-b513764827a9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:39.841534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:39.842921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:39.843461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:39.843880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] PATH_INFO: `/v3/users/78704e75433349b3b9c156acfd12b74d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:39.845493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=78704e75433349b3b9c156acfd12b74d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:39.851555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:39.912152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:39.975748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78704e75433349b3b9c156acfd12b74d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:39.996596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78704e75433349b3b9c156acfd12b74d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:39.997247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78704e75433349b3b9c156acfd12b74d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:40.021206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78704e75433349b3b9c156acfd12b74d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:40.048038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78704e75433349b3b9c156acfd12b74d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:40.063221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1101/2236] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:39 2022] DELETE /identity/v3/users/78704e75433349b3b9c156acfd12b74d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:40.068136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:40.068726 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:40.068726 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:40.097531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:40.099134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:40.255394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1136/2237] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:40.267570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:40.269069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:40.352419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a100a-f487-45a2-99ee-817dd43c52ef admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:40.358102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d77267-0467-460b-8cc1-d44d5cf23b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:40.359067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77267-0467-460b-8cc1-d44d5cf23b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:40.359501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77267-0467-460b-8cc1-d44d5cf23b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:40.360085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77267-0467-460b-8cc1-d44d5cf23b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:40.375236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d77267-0467-460b-8cc1-d44d5cf23b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:40.377022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d77267-0467-460b-8cc1-d44d5cf23b0f service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:40.389409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1102/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:40.869855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:40.871782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:40.906054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d03c50-571c-4cc5-87a0-a59d2e514173 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:40.927738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:40.929076 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:40.929590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:40.937317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] PATH_INFO: `/v3/projects/5649be8cb0fb46d49ece200c88edcabb` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:40.939417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5649be8cb0fb46d49ece200c88edcabb)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:40.942945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.052768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5649be8cb0fb46d49ece200c88edcabb', 'request_id': 'req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:41.068340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5649be8cb0fb46d49ece200c88edcabb', 'request_id': 'req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:41.076223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5649be8cb0fb46d49ece200c88edcabb', 'request_id': 'req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:41.090068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] The token cache is being invalidate because project 5649be8cb0fb46d49ece200c88edcabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:41.090372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:41.091285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2c2b6a98-5ff7-45b9-abcf-bd1ba2e13c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:41.093119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1137/2239] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:40 2022] DELETE /identity/v3/projects/5649be8cb0fb46d49ece200c88edcabb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:41.098635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.099216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.099216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.130970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:41.131995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:41.238143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1103/2240] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:41.247264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.247758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.248650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.279605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:41.281197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:41.294717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1138/2241] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:41.296431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.315678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be570069-b8ee-4892-a7d5-5e365265a0d8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:41.328738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:41.330033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.330621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.331140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.332571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:41.333163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:41.336590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.363391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1104/2242] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:41.368428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.385452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e8fa-7949-4e9d-a877-c8717aecc1ad None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:41.392491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:41.393196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.394174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.394871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.395733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:41.398857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.443261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1139/2243] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:41 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:41.449373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.470882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a092aa5-2d88-46de-af73-519fedb199d3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:41.534559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:41.586805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:41.587726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.588540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.588540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.589210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:41.591343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.626770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1105/2244] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:41 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:41.630595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.644138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b17f1-fb1e-4355-a910-12fbe1ef7c25 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:41.649712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:41.650938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.651364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.651770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.652623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:41.654852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.687806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1140/2245] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:41.691959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.710566 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dff1e-c3a1-4e83-808e-f2db1c418277 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:41.724766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02700873-58a9-4a97-a9e6-28074f9152ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:41.726150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700873-58a9-4a97-a9e6-28074f9152ac admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.727663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700873-58a9-4a97-a9e6-28074f9152ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.728043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700873-58a9-4a97-a9e6-28074f9152ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.728914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02700873-58a9-4a97-a9e6-28074f9152ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:41.734797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02700873-58a9-4a97-a9e6-28074f9152ac admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.750523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1106/2246] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:39:41.754624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.766376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1e76-2016-498a-9e3c-950a16cab361 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:41.775034 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:41.777684 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.778138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.778569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] PATH_INFO: `/v3/projects/5c7e4cad65fb44f2bb18b211cc743aa4/users/c96e5e89694c4dd9a48dd5aa7943e94d/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.806724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7e4cad65fb44f2bb18b211cc743aa4, user_id=c96e5e89694c4dd9a48dd5aa7943e94d, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:41.810893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:41.838087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1141/2247] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:41 2022] PUT /identity/v3/projects/5c7e4cad65fb44f2bb18b211cc743aa4/users/c96e5e89694c4dd9a48dd5aa7943e94d/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:41.851099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d2fb-06ae-44b6-b326-04737214a2b1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:41.851484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d2fb-06ae-44b6-b326-04737214a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:41.851709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d2fb-06ae-44b6-b326-04737214a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:41.880674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3402d2fb-06ae-44b6-b326-04737214a2b1 None None] MFA Rules not processed for user `c96e5e89694c4dd9a48dd5aa7943e94d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:41.882015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3402d2fb-06ae-44b6-b326-04737214a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:41.978821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1107/2248] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:41.991024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:41.993485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:42.045199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:42.144294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6711a95-6da8-459c-a074-d5df75b9c584 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:42.158219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:42.160075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:42.160569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:42.161040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:42.174771 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:42.176893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:42.207059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1142/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:44.030176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57370555-fb63-4860-b176-a963ad4c4c95 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:44.030674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57370555-fb63-4860-b176-a963ad4c4c95 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:44.030866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57370555-fb63-4860-b176-a963ad4c4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:44.086911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-57370555-fb63-4860-b176-a963ad4c4c95 None None] MFA Rules not processed for user `b4de631c92ac409f8e907807f54e516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:44.088412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-57370555-fb63-4860-b176-a963ad4c4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:44.197832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1108/2250] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:44.220006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:44.220006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:44.334071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341116-a043-494b-b654-81df351d9e07 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:44.340501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:44.341329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:44.341747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:44.342074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:44.351184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:44.352968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:44.365306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1143/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:46.227478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:46.227986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:46.228380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:46.253131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] MFA Rules not processed for user `b4de631c92ac409f8e907807f54e516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:46.254688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:46.287394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1109/2252] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:48.147104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:48.157470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7df4e-218b-47d2-a924-48d017e98d4f service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:48.161141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:48.161944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:48.162259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:48.162541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:48.164489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:48.250022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:48.251613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3520f-1104-4890-a250-ce9bece9b4c1 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:48.263271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1144/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:56.249228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:58.257902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=81 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:58.803653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:58.912582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd595bbf-d8e5-4bde-94dc-14efd408b850 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:58.922604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:58.928803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:58.929304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:58.931046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] PATH_INFO: `/v3/users/c96e5e89694c4dd9a48dd5aa7943e94d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:58.931600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96e5e89694c4dd9a48dd5aa7943e94d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:58.934274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:59.090880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96e5e89694c4dd9a48dd5aa7943e94d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.107492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96e5e89694c4dd9a48dd5aa7943e94d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.108291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96e5e89694c4dd9a48dd5aa7943e94d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.127225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96e5e89694c4dd9a48dd5aa7943e94d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.173855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96e5e89694c4dd9a48dd5aa7943e94d'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.191745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1110/2254] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:58 2022] DELETE /identity/v3/users/c96e5e89694c4dd9a48dd5aa7943e94d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:59.200867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:59.201706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:59.202879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:59.278952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:59.281871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:59.432962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1145/2255] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:39:59.447812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:59.449490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:59.529094 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d5f36-99b0-403f-8eea-cfe07f18a3a8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:59.543165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:59.544148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:59.544429 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:59.544701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:59.557399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:59.559103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:59.570015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1111/2256] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:59.857774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:59.859291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:59.872318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f4ae2-595f-4e60-9beb-e8818f49b868 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:59.878425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:59.879567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:59.879919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:59.880287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] PATH_INFO: `/v3/projects/5c7e4cad65fb44f2bb18b211cc743aa4` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:59.881841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7e4cad65fb44f2bb18b211cc743aa4)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:59.883873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:59.936633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7e4cad65fb44f2bb18b211cc743aa4', 'request_id': 'req-b8778537-c0a9-4e44-add0-e8f5c19b1062'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.945592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7e4cad65fb44f2bb18b211cc743aa4', 'request_id': 'req-b8778537-c0a9-4e44-add0-e8f5c19b1062'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.951654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7e4cad65fb44f2bb18b211cc743aa4', 'request_id': 'req-b8778537-c0a9-4e44-add0-e8f5c19b1062'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.967701 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] The token cache is being invalidate because project 5c7e4cad65fb44f2bb18b211cc743aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:59.968141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.969054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:59.971301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1146/2257] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:59 2022] DELETE /identity/v3/projects/5c7e4cad65fb44f2bb18b211cc743aa4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:09.565384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:09.965406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:13.416101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:13.417610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:13.430962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae55758-bb9d-458d-b718-e36075b1328f service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:13.487446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:13.488280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:13.488559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:13.488830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] PATH_INFO: `/v3/users/2ad2692a15d54bffa6b8cd90c0ffd72a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:13.490065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad2692a15d54bffa6b8cd90c0ffd72a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:13.492054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:13.542024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad2692a15d54bffa6b8cd90c0ffd72a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.548487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad2692a15d54bffa6b8cd90c0ffd72a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.549196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad2692a15d54bffa6b8cd90c0ffd72a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.556903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad2692a15d54bffa6b8cd90c0ffd72a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.569419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad2692a15d54bffa6b8cd90c0ffd72a'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.575462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1112/2258] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:13 2022] DELETE /identity/v3/users/2ad2692a15d54bffa6b8cd90c0ffd72a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:13.778179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:13.780671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:13.796762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8778537-c0a9-4e44-add0-e8f5c19b1062 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:13.881792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:13.883540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:13.883896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:13.884409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] PATH_INFO: `/v3/projects/c34f0701cdb845dc9ab0d4572bf8ae79` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:13.885813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34f0701cdb845dc9ab0d4572bf8ae79)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:13.888251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:13.940907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34f0701cdb845dc9ab0d4572bf8ae79', 'request_id': 'req-a40abd12-6da2-45e0-bc8d-d16466392427'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.949380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34f0701cdb845dc9ab0d4572bf8ae79', 'request_id': 'req-a40abd12-6da2-45e0-bc8d-d16466392427'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.955521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34f0701cdb845dc9ab0d4572bf8ae79', 'request_id': 'req-a40abd12-6da2-45e0-bc8d-d16466392427'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.975162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] The token cache is being invalidate because project c34f0701cdb845dc9ab0d4572bf8ae79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:13.975162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.975894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:13.983282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1147/2259] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:13 2022] DELETE /identity/v3/projects/c34f0701cdb845dc9ab0d4572bf8ae79 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:13.989498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:13.990954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:14.004772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8f7c6-64c2-46d8-b52d-8bbdec1b1153 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.074875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.075817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.076102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.076370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] PATH_INFO: `/v3/users/47d5a8c165444be083ea53ac8e0350cd` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.077630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d5a8c165444be083ea53ac8e0350cd)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.079908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:14.108508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:14.140777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d5a8c165444be083ea53ac8e0350cd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.148665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d5a8c165444be083ea53ac8e0350cd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.149477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d5a8c165444be083ea53ac8e0350cd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.157070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d5a8c165444be083ea53ac8e0350cd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.170951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-e9093128-f162-4d88-a766-e86ed4d054c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d5a8c165444be083ea53ac8e0350cd'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.177508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1113/2260] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:13 2022] DELETE /identity/v3/users/47d5a8c165444be083ea53ac8e0350cd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:14.375361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:14.377724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:14.409491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40abd12-6da2-45e0-bc8d-d16466392427 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.479793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.480677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.480955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.481224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] PATH_INFO: `/v3/projects/4f11d4e6db3f4655a974f522af26fc23` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.482531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f11d4e6db3f4655a974f522af26fc23)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.484476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:14.526669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:14.541501 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f11d4e6db3f4655a974f522af26fc23', 'request_id': 'req-5b9f68d3-df0a-4273-91ee-a50bfe951c13'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.549606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f11d4e6db3f4655a974f522af26fc23', 'request_id': 'req-5b9f68d3-df0a-4273-91ee-a50bfe951c13'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.556364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f11d4e6db3f4655a974f522af26fc23', 'request_id': 'req-5b9f68d3-df0a-4273-91ee-a50bfe951c13'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.568507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] The token cache is being invalidate because project 4f11d4e6db3f4655a974f522af26fc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:14.568798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.569584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5b9f68d3-df0a-4273-91ee-a50bfe951c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:14.571423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1148/2261] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:14 2022] DELETE /identity/v3/projects/4f11d4e6db3f4655a974f522af26fc23 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:14.577366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.578001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.578001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.598225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:14.599573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:14.665584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1114/2262] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:14.675129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.675367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.675682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.697347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:14.699451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:14.710718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1149/2263] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:14.715490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:14.732897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343571-1f94-4e52-8dcf-c8c6d78f3168 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.741701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.742525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.742867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.743239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.744163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:14.744537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.746299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:14.759582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1115/2264] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:14.764125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:14.774257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207b5e-509d-4353-ab1c-25bfd3f42071 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.787471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.788553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.788908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.789117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.789919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.792218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:14.823125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1150/2265] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:14 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:14.825643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:14.837213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be693e04-ace8-468c-abee-258b377d6d0a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.906175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.907252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.907641 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.907976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.908684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.910758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:14.933556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1116/2266] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:14 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:14.937903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:14.948857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79912-f72d-46df-846c-535fa88e7828 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.953592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.954255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.954537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.954808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.955584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.957208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:14.967986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1151/2267] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:14.972269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:14.983184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3601b6-b5b7-47bb-bb3f-a1b51d319a8e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:14.988716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef6405-d6fc-4695-9afe-7d329e948073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:14.989438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6405-d6fc-4695-9afe-7d329e948073 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:14.989721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6405-d6fc-4695-9afe-7d329e948073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:14.989994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6405-d6fc-4695-9afe-7d329e948073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:14.990928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6405-d6fc-4695-9afe-7d329e948073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:14.993234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6405-d6fc-4695-9afe-7d329e948073 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:15.008259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1117/2268] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:15.014475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:15.028537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4af07-d8c3-4aa7-a06a-a380620804ca admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:15.035585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:15.036497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:15.036774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:15.037100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] PATH_INFO: `/v3/projects/c4198cf19e29479fb6de4dd540523bad/users/6f82ca09de604bf8a3330ac9d42f2b8c/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:15.057511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4198cf19e29479fb6de4dd540523bad, user_id=6f82ca09de604bf8a3330ac9d42f2b8c, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:15.060278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:15.077203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1152/2269] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:15 2022] PUT /identity/v3/projects/c4198cf19e29479fb6de4dd540523bad/users/6f82ca09de604bf8a3330ac9d42f2b8c/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:15.091153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:15.091581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:15.091958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:15.100254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:15.126001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] MFA Rules not processed for user `6f82ca09de604bf8a3330ac9d42f2b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:15.127281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:15.226170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1118/2270] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:15.235500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:15.237792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:15.313586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6176cb-7a34-4bc2-a507-ea84d8aae809 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:15.317446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1058d30-5a6f-4e89-aeff-7a09e0b4c79e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:15.318123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058d30-5a6f-4e89-aeff-7a09e0b4c79e service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:15.318412 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058d30-5a6f-4e89-aeff-7a09e0b4c79e service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:15.318682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058d30-5a6f-4e89-aeff-7a09e0b4c79e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:15.328424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1058d30-5a6f-4e89-aeff-7a09e0b4c79e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:15.329889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1058d30-5a6f-4e89-aeff-7a09e0b4c79e service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:15.339855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1153/2271] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:19.745108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:19.746732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:19.813526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8330fb-6279-4720-99c8-e2e257e8df9a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:19.818363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:19.819483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:19.819774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:19.820071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] PATH_INFO: `/v3/users/28ff5803b68a4a4d8916d36d86578d46` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:19.821587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ff5803b68a4a4d8916d36d86578d46)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:19.823730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:19.873160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ff5803b68a4a4d8916d36d86578d46'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:19.882511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ff5803b68a4a4d8916d36d86578d46'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:19.883926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ff5803b68a4a4d8916d36d86578d46'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:19.892523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ff5803b68a4a4d8916d36d86578d46'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:19.905425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ff5803b68a4a4d8916d36d86578d46'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:19.911815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1119/2272] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:19 2022] DELETE /identity/v3/users/28ff5803b68a4a4d8916d36d86578d46 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:19.916597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:19.917087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:19.917195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:19.935322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:19.936524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:19.991062 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:20.005763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1154/2273] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:20.013284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.015424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.032903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:20.081629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628182c6-431a-4370-8c31-ec5ec811d77d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.085897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52fcd-4dfa-47fd-8250-97a24d4e268f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.086550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52fcd-4dfa-47fd-8250-97a24d4e268f service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.086826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52fcd-4dfa-47fd-8250-97a24d4e268f service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.087127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52fcd-4dfa-47fd-8250-97a24d4e268f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.097626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce52fcd-4dfa-47fd-8250-97a24d4e268f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.099092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce52fcd-4dfa-47fd-8250-97a24d4e268f service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.109055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1120/2274] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:20.386023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.388008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.400969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a955a2f-cb4b-4e56-a02b-411205f83c9b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.405996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.406867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.407175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.407440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] PATH_INFO: `/v3/projects/a194654aaa8f4238a7a0bdc84352cec1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.408643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a194654aaa8f4238a7a0bdc84352cec1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.410606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.459485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a194654aaa8f4238a7a0bdc84352cec1', 'request_id': 'req-ab86f33d-7981-46dd-91ab-673d90635492'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.468244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a194654aaa8f4238a7a0bdc84352cec1', 'request_id': 'req-ab86f33d-7981-46dd-91ab-673d90635492'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.474605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a194654aaa8f4238a7a0bdc84352cec1', 'request_id': 'req-ab86f33d-7981-46dd-91ab-673d90635492'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.486435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] The token cache is being invalidate because project a194654aaa8f4238a7a0bdc84352cec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:20.486647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.487381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ab86f33d-7981-46dd-91ab-673d90635492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.488959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1155/2275] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:20 2022] DELETE /identity/v3/projects/a194654aaa8f4238a7a0bdc84352cec1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:20.493873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.494235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.494581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.513675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:20.514929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.583037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1121/2276] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:20.592539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.592824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.593104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.620418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:20.621633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.630831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1156/2277] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:20.634983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.646425 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c0674-29a8-420d-be5f-22fe51cc96b6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.651888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.652572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.652856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.653128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.653978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:20.654289 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.655966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.668473 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1122/2278] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:40:20.673081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.682984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efb286-1bf7-4466-98d1-9047bc2c51ff None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.687818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.688426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.688702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.688973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.689668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.691673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.722531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1157/2279] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:20 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:20.726835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.736998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0387-e8c8-4692-a75d-2ce17ad24392 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.751920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.753721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.801312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.802008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.802283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.802564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.803510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.805611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.821193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea9ce4-c02a-46ef-80e5-01f972963c7b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.826068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.826970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.827278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.827544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] PATH_INFO: `/v3/users/6f82ca09de604bf8a3330ac9d42f2b8c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.827854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1123/2280] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:20 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:20.831798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f82ca09de604bf8a3330ac9d42f2b8c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.831920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.833740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.841744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb097-d2b7-4492-abc7-d984623eaedd admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.846376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.847214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.847502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.847759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.848516 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.850090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.860533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1124/2281] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:20.864489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.875106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04f63-561e-477a-a96c-6afd9c45107b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.880382 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.881129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.881350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.881625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.882529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.884188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.886741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f82ca09de604bf8a3330ac9d42f2b8c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.899092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1125/2282] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:20.900242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f82ca09de604bf8a3330ac9d42f2b8c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.900242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f82ca09de604bf8a3330ac9d42f2b8c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.900948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:20.901333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:20.903367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.907394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f82ca09de604bf8a3330ac9d42f2b8c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.908924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-856e90c8-694a-4d98-8f4c-18d70c172224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f82ca09de604bf8a3330ac9d42f2b8c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:20.918581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03f366-0728-42ab-a57c-1f601a0e6ca1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:20.923244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59718f-5262-4356-ae7e-7faf96058fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:20.924139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59718f-5262-4356-ae7e-7faf96058fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.924424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59718f-5262-4356-ae7e-7faf96058fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.924725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59718f-5262-4356-ae7e-7faf96058fe8 admin admin] PATH_INFO: `/v3/projects/bcbb84957a6f47bf8ad398cc1acd1140/users/4341db78640f409a919da947393ef1ea/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.928151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1158/2283] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:20 2022] DELETE /identity/v3/users/6f82ca09de604bf8a3330ac9d42f2b8c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:20.932817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.934199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.934841 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.934954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:20.942884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59718f-5262-4356-ae7e-7faf96058fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbb84957a6f47bf8ad398cc1acd1140, user_id=4341db78640f409a919da947393ef1ea, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:20.945612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59718f-5262-4356-ae7e-7faf96058fe8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:20.952522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:20.954172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:20.959932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1126/2284] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:20 2022] PUT /identity/v3/projects/bcbb84957a6f47bf8ad398cc1acd1140/users/4341db78640f409a919da947393ef1ea/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:20.970120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:20.970409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:20.970685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:20.998583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] MFA Rules not processed for user `4341db78640f409a919da947393ef1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:20.999891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:21.016679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1159/2285] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:21.026806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.028395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:21.064901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1127/2286] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:21.076477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.077913 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:21.088765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1dea5-fcfe-4c8a-b623-fc712a3655fd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.092242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.092892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.093171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.093497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.104132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.105621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.115993 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1160/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:40:21.141644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf874-680d-49ca-88fc-4d3fa0e68ee5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.145475 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043768d-1c24-417b-afc4-054ee43bef5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.146131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043768d-1c24-417b-afc4-054ee43bef5d service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.146406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043768d-1c24-417b-afc4-054ee43bef5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.146684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043768d-1c24-417b-afc4-054ee43bef5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.155832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043768d-1c24-417b-afc4-054ee43bef5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.157406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043768d-1c24-417b-afc4-054ee43bef5d service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.168565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1128/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:21.428618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.428618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:21.451652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b24b3-a550-41b3-afa4-13797d409c81 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.467175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.468135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.468430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.468705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] PATH_INFO: `/v3/projects/c4198cf19e29479fb6de4dd540523bad` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.469935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4198cf19e29479fb6de4dd540523bad)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.472139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.525402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4198cf19e29479fb6de4dd540523bad', 'request_id': 'req-0301694b-fb5e-4654-bbd1-1212824164ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:21.535548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4198cf19e29479fb6de4dd540523bad', 'request_id': 'req-0301694b-fb5e-4654-bbd1-1212824164ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:21.541060 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4198cf19e29479fb6de4dd540523bad', 'request_id': 'req-0301694b-fb5e-4654-bbd1-1212824164ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:21.549349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:21.554221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] The token cache is being invalidate because project c4198cf19e29479fb6de4dd540523bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:21.554779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:21.556089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0301694b-fb5e-4654-bbd1-1212824164ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:21.557860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1161/2289] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:21 2022] DELETE /identity/v3/projects/c4198cf19e29479fb6de4dd540523bad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:21.563192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.563484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.563767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.582257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:21.583625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:21.645563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1129/2290] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:21.653574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.653905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.654156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.674862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:21.676120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:21.686855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1162/2291] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:21.691398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.702256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c10326-0c6e-47b8-97b2-3c5b88cc698f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.707119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.708009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.708301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.708572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.709357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:21.709672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.711349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.725413 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1130/2292] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:21.729624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.747482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f6e6-c940-4d59-8e76-c1c5316b67b2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.753105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.753833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.754141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.754402 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.755209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.757189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.787031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1163/2293] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:21 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:21.790881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.801091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38f599-5d18-4507-aa89-c64534feb974 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.806006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:21.863086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.863771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.864048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.864320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.865140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.867130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.893159 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1131/2294] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:21 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:21.896413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.906678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9349b2-c105-42c4-8020-cfe8ca80ddff admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.911756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.912428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.912705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.912978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.913714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.915376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.926452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1164/2295] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:21.931337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.945287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00077155-d4ce-4dc5-ba20-10bbb27f116f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.950332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f72b4e-e47c-4c01-a875-0be91208f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.951090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72b4e-e47c-4c01-a875-0be91208f191 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.951377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72b4e-e47c-4c01-a875-0be91208f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.951669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72b4e-e47c-4c01-a875-0be91208f191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:21.952564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f72b4e-e47c-4c01-a875-0be91208f191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:21.954254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f72b4e-e47c-4c01-a875-0be91208f191 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:21.965922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1132/2296] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:21.970260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:21.981419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d4c5-288e-4e7b-9730-beaf9309ab08 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:21.986488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:21.987469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:21.987743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:21.988068 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] PATH_INFO: `/v3/projects/32db9d662c634b799cb3b594f3ed15e2/users/b121271b2f8a48968c55a17246bfe889/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:22.004480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32db9d662c634b799cb3b594f3ed15e2, user_id=b121271b2f8a48968c55a17246bfe889, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:22.007252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:22.024389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1165/2297] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:21 2022] PUT /identity/v3/projects/32db9d662c634b799cb3b594f3ed15e2/users/b121271b2f8a48968c55a17246bfe889/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:22.036733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:22.037022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:22.037333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:22.070530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] MFA Rules not processed for user `b121271b2f8a48968c55a17246bfe889`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:22.071803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:22.145743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1133/2298] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:22.160532 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:22.163855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:22.232570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd003f-860b-4fd4-a077-de2556587c08 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:22.236479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab7640-ded1-44cc-bce0-47c308ec1cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:22.237172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab7640-ded1-44cc-bce0-47c308ec1cfc service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:22.237458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab7640-ded1-44cc-bce0-47c308ec1cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:22.237736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab7640-ded1-44cc-bce0-47c308ec1cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:22.247968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab7640-ded1-44cc-bce0-47c308ec1cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:22.249436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab7640-ded1-44cc-bce0-47c308ec1cfc service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:22.259341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1166/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:22.773141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:22.774676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:22.840977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a450f6-0ad7-4757-b5ee-973ff70a199d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:22.845518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:22.846410 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:22.846684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:22.846954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] PATH_INFO: `/v3/users/b443981a52c2468ab6ec7a16ee8c2c84` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:22.848185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b443981a52c2468ab6ec7a16ee8c2c84)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:22.850149 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:22.866629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:22.902375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b443981a52c2468ab6ec7a16ee8c2c84'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:22.912171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b443981a52c2468ab6ec7a16ee8c2c84'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:22.913131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b443981a52c2468ab6ec7a16ee8c2c84'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:22.921813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b443981a52c2468ab6ec7a16ee8c2c84'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:22.936798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b443981a52c2468ab6ec7a16ee8c2c84'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:22.945488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1134/2300] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:22 2022] DELETE /identity/v3/users/b443981a52c2468ab6ec7a16ee8c2c84 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:22.950388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:22.950752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:22.951108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:22.972558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:22.988785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:23.092281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1167/2301] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:23.103193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.104650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:23.169451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabeccd-1404-4889-b184-32bb7f455321 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:23.173194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8088-1e8a-45a9-8af7-b7b6941da208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:23.173769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8088-1e8a-45a9-8af7-b7b6941da208 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.174049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8088-1e8a-45a9-8af7-b7b6941da208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.174315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8088-1e8a-45a9-8af7-b7b6941da208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.184001 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8088-1e8a-45a9-8af7-b7b6941da208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:23.185432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8088-1e8a-45a9-8af7-b7b6941da208 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:23.195581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1135/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:23.500069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.501541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:23.514477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7235d1-adf5-4131-9db4-39b40b219411 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:23.520406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:23.521330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.521584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.521850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] PATH_INFO: `/v3/projects/a840ad63cfbe4a98a2f9ee27c954d8e0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.523309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a840ad63cfbe4a98a2f9ee27c954d8e0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:23.525263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:23.566577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:23.580825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a840ad63cfbe4a98a2f9ee27c954d8e0', 'request_id': 'req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:23.589284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a840ad63cfbe4a98a2f9ee27c954d8e0', 'request_id': 'req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:23.596192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a840ad63cfbe4a98a2f9ee27c954d8e0', 'request_id': 'req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:23.608283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] The token cache is being invalidate because project a840ad63cfbe4a98a2f9ee27c954d8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:23.608578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:23.609313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f6759f1-8fa9-4f4d-ad3d-d42bddcf8a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:23.611369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1168/2303] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:23 2022] DELETE /identity/v3/projects/a840ad63cfbe4a98a2f9ee27c954d8e0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:23.617032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.617322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.617596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.636925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:23.638521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:23.707142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1136/2304] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:23.711571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.711858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.712130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.732326 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:23.733690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:23.753161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1169/2305] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:23.754463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.764650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa28931-6948-4a56-8a0a-453cab2e5542 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:23.769593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:23.770394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.770741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.771367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.772190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:23.772483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:23.774193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:23.792760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1137/2306] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:23.794403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.807464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e867e6-071d-4079-aa88-da5c179ace18 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:23.812457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:23.813135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.813413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.813712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.814464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:23.816529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:23.846193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1170/2307] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:23 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:23.850891 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.862121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9e71-e703-4abe-ba87-8e48137c908c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:23.884214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:23.924869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:23.925564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.925861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.926130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.926824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:23.928949 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:23.949996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1138/2308] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:23 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:23.954341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.964781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d207d77-29ed-481a-b857-d717f1402e31 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:23.969835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:23.970506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:23.970780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:23.971082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:23.971859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:23.973523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:23.984153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1171/2309] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:23.988529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:23.999309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448674bb-09f3-46c9-8ad8-b12bb8ccef1d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:24.004992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5748-9df7-4368-8a4d-5411afa80016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:24.005666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5748-9df7-4368-8a4d-5411afa80016 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.005950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5748-9df7-4368-8a4d-5411afa80016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.006220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5748-9df7-4368-8a4d-5411afa80016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.006953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5748-9df7-4368-8a4d-5411afa80016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:24.008602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5748-9df7-4368-8a4d-5411afa80016 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:24.019537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1139/2310] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:24.023954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:24.037091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ba20f-17a6-44a9-a84a-4dab9d521fc6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:24.042085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:24.043017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.043327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.043597 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] PATH_INFO: `/v3/projects/ce2217c607cb44468f1e68163c66d846/users/b82d2aea43e542509a061b8722438d05/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.059128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2217c607cb44468f1e68163c66d846, user_id=b82d2aea43e542509a061b8722438d05, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:24.061837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:24.083848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1172/2311] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:24 2022] PUT /identity/v3/projects/ce2217c607cb44468f1e68163c66d846/users/b82d2aea43e542509a061b8722438d05/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:24.102685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.103208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.103667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.139788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] MFA Rules not processed for user `b82d2aea43e542509a061b8722438d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:24.140994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:24.221498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1140/2312] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:24.233863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:24.236044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:24.308446 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f76b-ccad-4e30-9101-6f7b96086825 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:24.321644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b4658-e7e6-478d-9daa-6c8f1070d149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:24.322429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b4658-e7e6-478d-9daa-6c8f1070d149 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.322620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b4658-e7e6-478d-9daa-6c8f1070d149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.322894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b4658-e7e6-478d-9daa-6c8f1070d149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.334651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b4658-e7e6-478d-9daa-6c8f1070d149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:24.336158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b4658-e7e6-478d-9daa-6c8f1070d149 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:24.345522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1173/2313] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:24.372383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:24.437989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8e887-9a46-4c95-9952-bfc49e34a86f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:24.443119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:24.443936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.444222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.444535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] PATH_INFO: `/v3/users/b82d2aea43e542509a061b8722438d05` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.445808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82d2aea43e542509a061b8722438d05)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:24.447855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:24.489368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:24.501078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82d2aea43e542509a061b8722438d05'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.509502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82d2aea43e542509a061b8722438d05'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.510140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82d2aea43e542509a061b8722438d05'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.517749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82d2aea43e542509a061b8722438d05'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.532777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82d2aea43e542509a061b8722438d05'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.539879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1141/2314] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:24 2022] DELETE /identity/v3/users/b82d2aea43e542509a061b8722438d05 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:24.544542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.544850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.545131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.565016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:24.566255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:24.641041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1174/2315] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:24.650020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:24.651497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:24.713123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e1897-579b-4fd1-a613-10ba6e01c2f1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:24.716911 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51781b37-6ba1-40f3-ad96-35a7594cc8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:24.717567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51781b37-6ba1-40f3-ad96-35a7594cc8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.717855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51781b37-6ba1-40f3-ad96-35a7594cc8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.718124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51781b37-6ba1-40f3-ad96-35a7594cc8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.728295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51781b37-6ba1-40f3-ad96-35a7594cc8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:24.730391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51781b37-6ba1-40f3-ad96-35a7594cc8a2 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:24.746801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1142/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:24.828378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:24.829899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:24.837111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:24.844584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a2f9e-10f6-4f5a-8cd0-53afb03f2aa6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:24.851275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:24.852180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.852682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.852795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] PATH_INFO: `/v3/users/b121271b2f8a48968c55a17246bfe889` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.854249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b121271b2f8a48968c55a17246bfe889)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:24.855960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:24.918983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b121271b2f8a48968c55a17246bfe889'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.930142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b121271b2f8a48968c55a17246bfe889'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.930912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b121271b2f8a48968c55a17246bfe889'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.938380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b121271b2f8a48968c55a17246bfe889'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.939040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b121271b2f8a48968c55a17246bfe889'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:24.957442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1175/2317] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:24 2022] DELETE /identity/v3/users/b121271b2f8a48968c55a17246bfe889 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:24.962304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:24.962788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:24.962864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:24.983035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:24.984284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.029602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.032287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.063141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1143/2318] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:25.075808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.077875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.103629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dcd06-fc60-4db8-847a-5653a088c509 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.112285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.114342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.114620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.114889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] PATH_INFO: `/v3/projects/ce2217c607cb44468f1e68163c66d846` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.116130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2217c607cb44468f1e68163c66d846)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.118047 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.142656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2926e-7af5-4f4f-a552-e94900b363fd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.146411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a30cd5-b2bc-4f26-9bd7-868de303e610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.147103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a30cd5-b2bc-4f26-9bd7-868de303e610 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.147385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a30cd5-b2bc-4f26-9bd7-868de303e610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.147707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a30cd5-b2bc-4f26-9bd7-868de303e610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.157282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a30cd5-b2bc-4f26-9bd7-868de303e610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.158800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a30cd5-b2bc-4f26-9bd7-868de303e610 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.162937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:25.168311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2217c607cb44468f1e68163c66d846', 'request_id': 'req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.170038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1144/2319] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:25.176174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2217c607cb44468f1e68163c66d846', 'request_id': 'req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.182763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2217c607cb44468f1e68163c66d846', 'request_id': 'req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.198268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] The token cache is being invalidate because project ce2217c607cb44468f1e68163c66d846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:25.198592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.199638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4fdfe2e3-a6ea-40b3-b8bc-ca8c64142ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.201426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1176/2320] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:25 2022] DELETE /identity/v3/projects/ce2217c607cb44468f1e68163c66d846 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:25.206638 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.207054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.207409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.229436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:25.231274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.304915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1145/2321] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:25.312936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.313306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.313750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.322111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:25.349948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:25.351208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.361166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1177/2322] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:25.364683 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.375194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f485b6-a839-4400-be47-13b9bcd91159 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.381350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.382056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.382568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.382568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.383472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:25.384043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.385751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.403587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1146/2323] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:25.405050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.415334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81ab96-d114-4645-93f3-3dce91cc9899 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.421071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.421956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.422304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.422644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.423456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.425473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.466156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1178/2324] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:25 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:25.470498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.486710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca584ad-78fc-44ad-bf97-ccc3e6570da5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.503895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.505729 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.555232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.555994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.556209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.556467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.557180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.559233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.579770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1147/2325] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:25 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:25.582653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b53ce-bee5-44c9-b2ad-1c62ad52fef0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.584246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.587498 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.588407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.588682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.589090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] PATH_INFO: `/v3/projects/32db9d662c634b799cb3b594f3ed15e2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.590652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32db9d662c634b799cb3b594f3ed15e2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.592628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.594370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc53bda-ba87-41bc-8e07-63f7650eb2b2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.599349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.600015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.600294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.600567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.601304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.602906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.613785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1148/2326] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:25.618603 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.630464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc55afb-01d2-4a89-b26d-194cd383edd8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.647210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32db9d662c634b799cb3b594f3ed15e2', 'request_id': 'req-cb01c959-c1f7-4272-9637-343e74a34512'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.657432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32db9d662c634b799cb3b594f3ed15e2', 'request_id': 'req-cb01c959-c1f7-4272-9637-343e74a34512'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.665304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32db9d662c634b799cb3b594f3ed15e2', 'request_id': 'req-cb01c959-c1f7-4272-9637-343e74a34512'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.680191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] The token cache is being invalidate because project 32db9d662c634b799cb3b594f3ed15e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:25.680826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.681629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:25.683564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1179/2327] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:25 2022] DELETE /identity/v3/projects/32db9d662c634b799cb3b594f3ed15e2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:25.693261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895f1b2-29bb-4eb9-be9b-080cb9ae21ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.693962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f1b2-29bb-4eb9-be9b-080cb9ae21ae admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.694411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f1b2-29bb-4eb9-be9b-080cb9ae21ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.694694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f1b2-29bb-4eb9-be9b-080cb9ae21ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.695534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895f1b2-29bb-4eb9-be9b-080cb9ae21ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.697212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895f1b2-29bb-4eb9-be9b-080cb9ae21ae admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.704072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:25.713606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1149/2328] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:25.714858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.720860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.735649 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c959-c1f7-4272-9637-343e74a34512 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.740891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:25.741806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.742286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.742409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] PATH_INFO: `/v3/projects/5cc641619ba74643adace5a00be154b5/users/fe8d17a26d3c48c58f3f6a4a8acd4930/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.767369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc641619ba74643adace5a00be154b5, user_id=fe8d17a26d3c48c58f3f6a4a8acd4930, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:25.770488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:25.795107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1180/2329] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:25 2022] PUT /identity/v3/projects/5cc641619ba74643adace5a00be154b5/users/fe8d17a26d3c48c58f3f6a4a8acd4930/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:25.797872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481e88-b9a3-4e9b-b8b9-5668b3aa1c74 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:25.798235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481e88-b9a3-4e9b-b8b9-5668b3aa1c74 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:25.798529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01481e88-b9a3-4e9b-b8b9-5668b3aa1c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:25.832839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-01481e88-b9a3-4e9b-b8b9-5668b3aa1c74 None None] MFA Rules not processed for user `fe8d17a26d3c48c58f3f6a4a8acd4930`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:25.834264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-01481e88-b9a3-4e9b-b8b9-5668b3aa1c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.915014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1150/2330] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:25.927179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:25.929835 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:25.981534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:25.995541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eec6c4-84ea-4e19-b7cf-770eb845b125 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:25.999522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6905c-88ab-485d-b6be-9af375bb3284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:26.000289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6905c-88ab-485d-b6be-9af375bb3284 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:26.000640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6905c-88ab-485d-b6be-9af375bb3284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:26.000987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6905c-88ab-485d-b6be-9af375bb3284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:26.010571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6905c-88ab-485d-b6be-9af375bb3284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:26.012435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6905c-88ab-485d-b6be-9af375bb3284 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:26.022220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1181/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:27.260033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006c97-beab-43af-9847-594dbaacfd5b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.260598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006c97-beab-43af-9847-594dbaacfd5b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.260598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006c97-beab-43af-9847-594dbaacfd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.281927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dc006c97-beab-43af-9847-594dbaacfd5b None None] MFA Rules not processed for user `71faa4cc60f74a089fdf763ba13f56fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:27.283369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dc006c97-beab-43af-9847-594dbaacfd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:27.342041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1151/2332] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:27.461311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.461311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.461311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.478483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] MFA Rules not processed for user `fe8d17a26d3c48c58f3f6a4a8acd4930`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:27.479854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:27.488743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1182/2333] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:37.333634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=57 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:37.473395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:48.625694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ef82-5d76-477e-b1ff-3a95cbe17bec None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.626187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ef82-5d76-477e-b1ff-3a95cbe17bec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.626277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ef82-5d76-477e-b1ff-3a95cbe17bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.645954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bab4ef82-5d76-477e-b1ff-3a95cbe17bec None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:48.647139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bab4ef82-5d76-477e-b1ff-3a95cbe17bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:48.709786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1152/2334] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:40:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:48.751008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.752580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:48.824542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106df3-e922-4b48-8ecf-f3e6a26a1568 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.833707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.834683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.835138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.835560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.850054 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.851707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.860967 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1183/2335] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:40:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:49.442798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205611e0-0e35-4835-92d0-3a845ee13c6d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.443121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205611e0-0e35-4835-92d0-3a845ee13c6d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.443401 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205611e0-0e35-4835-92d0-3a845ee13c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.462744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-205611e0-0e35-4835-92d0-3a845ee13c6d None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:49.464000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-205611e0-0e35-4835-92d0-3a845ee13c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:49.471819 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1153/2336] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 22:40:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:49.485023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:49.497251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b6a1-5137-4ba0-8333-20e523b19352 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:49.503440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:49.504089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.504370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.504643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.514549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:49.516188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:49.524905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1184/2337] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:49.742040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d19ee-1a15-4e01-a93e-95b563a7ba5d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.742585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d19ee-1a15-4e01-a93e-95b563a7ba5d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.742585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d19ee-1a15-4e01-a93e-95b563a7ba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.768365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cf8d19ee-1a15-4e01-a93e-95b563a7ba5d None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:49.769558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cf8d19ee-1a15-4e01-a93e-95b563a7ba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:49.777837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1154/2338] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:40:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:49.790379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:49.801515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3eb2-73f7-4e7e-a7c7-0eb50460a435 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:49.807719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:49.808386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.808664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.808940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.817567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:49.819212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:49.827594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1185/2339] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:50.184672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:50.185082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:50.185460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:50.208059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:50.209276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:50.217967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1155/2340] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 22:40:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:50.230708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:50.241905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541afe66-9d94-4902-b402-f8f0d4cd7fb8 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:50.248698 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ac03-930a-4b85-81e2-e75b723c921e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:50.249352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ac03-930a-4b85-81e2-e75b723c921e service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:50.249634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ac03-930a-4b85-81e2-e75b723c921e service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:50.249908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ac03-930a-4b85-81e2-e75b723c921e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:50.258617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9ac03-930a-4b85-81e2-e75b723c921e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:50.260284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9ac03-930a-4b85-81e2-e75b723c921e service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:50.271969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1186/2341] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:40:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:52.433662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:52.505837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77cb4-5e47-4386-85a7-60bc18ca125f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:52.511529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:52.512483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:52.513092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:52.513390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] PATH_INFO: `/v3/users/fe8d17a26d3c48c58f3f6a4a8acd4930` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:52.514743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8d17a26d3c48c58f3f6a4a8acd4930)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:52.516745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:52.570946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8d17a26d3c48c58f3f6a4a8acd4930'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:52.579812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8d17a26d3c48c58f3f6a4a8acd4930'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:52.580436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8d17a26d3c48c58f3f6a4a8acd4930'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:52.587785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8d17a26d3c48c58f3f6a4a8acd4930'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:52.599989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8d17a26d3c48c58f3f6a4a8acd4930'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:52.606185 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1156/2342] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:52 2022] DELETE /identity/v3/users/fe8d17a26d3c48c58f3f6a4a8acd4930 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:52.610866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:52.611393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:52.611485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:52.630314 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:52.631588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:52.697202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1187/2343] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:52.708376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:52.710043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:52.718518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:52.781047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387ecf-7000-4b83-80a5-2e5cc88e2205 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:52.784734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84ed2c-b0f2-48ab-841d-f4e84fc807f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:52.785384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ed2c-b0f2-48ab-841d-f4e84fc807f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:52.785662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ed2c-b0f2-48ab-841d-f4e84fc807f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:52.785931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ed2c-b0f2-48ab-841d-f4e84fc807f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:52.795662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84ed2c-b0f2-48ab-841d-f4e84fc807f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:52.797087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84ed2c-b0f2-48ab-841d-f4e84fc807f5 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:52.806705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1157/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:52.988921 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:52.991185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:53.006608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6687-f46e-4232-8789-27f5fe719cd0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.012425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.013689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.014164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.014626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] PATH_INFO: `/v3/projects/5cc641619ba74643adace5a00be154b5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.016681 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc641619ba74643adace5a00be154b5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.019273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.068599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:53.071641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc641619ba74643adace5a00be154b5', 'request_id': 'req-9a6fe011-f283-4467-8ead-049265dbf219'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:53.080491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc641619ba74643adace5a00be154b5', 'request_id': 'req-9a6fe011-f283-4467-8ead-049265dbf219'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:53.086665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc641619ba74643adace5a00be154b5', 'request_id': 'req-9a6fe011-f283-4467-8ead-049265dbf219'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:53.099310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] The token cache is being invalidate because project 5cc641619ba74643adace5a00be154b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:53.099788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:53.100485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9a6fe011-f283-4467-8ead-049265dbf219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:53.102718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1188/2345] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:52 2022] DELETE /identity/v3/projects/5cc641619ba74643adace5a00be154b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:53.108210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.108561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.108827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.127344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:53.128571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:53.191860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1158/2346] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:53.200126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.200459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.200740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.220045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:53.221373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:53.231951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1189/2347] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:53.236931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.249283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5efc1e-6513-4879-bab1-655ec7bd0048 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.254451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.255167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.255469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.255740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.256514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:53.256820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.258511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.279034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1159/2348] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:53.281859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.291376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59e7d-ae71-4938-a2e8-d83750d06221 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.296640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.297529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.297842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.298246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.299021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.301080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.327996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1190/2349] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:53 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:53.332114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.342379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba6cf-9a73-41f1-8674-78ed5c37aa10 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.408707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.409392 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.409684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.409951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.410661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.412652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.433871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1160/2350] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:53 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:53.440431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.454648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bd2d9-63fc-495b-97d8-d87064296d06 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.459666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.460329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.460608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.460879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.461618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.463260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.474461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1191/2351] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:53.478615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.489090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d1544-703e-4dbc-a2e5-e3f4f78cc6db admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.494295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1803-ad0b-4513-8098-68c3930da782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.494980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1803-ad0b-4513-8098-68c3930da782 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.495302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1803-ad0b-4513-8098-68c3930da782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.495577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1803-ad0b-4513-8098-68c3930da782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.496338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce1803-ad0b-4513-8098-68c3930da782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.497940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce1803-ad0b-4513-8098-68c3930da782 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.507955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1161/2352] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:53.513095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.527968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c835d-fc15-45d1-b014-26d8e8174c23 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.533071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.533960 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.534237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.534512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] PATH_INFO: `/v3/projects/fdfac224c1ba4334acdad787449adafa/users/61a118af05b24a0d9d413834ce80a700/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.550175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfac224c1ba4334acdad787449adafa, user_id=61a118af05b24a0d9d413834ce80a700, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.552889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.568821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1192/2353] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:53 2022] PUT /identity/v3/projects/fdfac224c1ba4334acdad787449adafa/users/61a118af05b24a0d9d413834ce80a700/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:53.575775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b7c2a-3b35-4dfc-9095-fd2906ae78a9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.576085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b7c2a-3b35-4dfc-9095-fd2906ae78a9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.576387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b7c2a-3b35-4dfc-9095-fd2906ae78a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.594872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e59b7c2a-3b35-4dfc-9095-fd2906ae78a9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:53.596155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e59b7c2a-3b35-4dfc-9095-fd2906ae78a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:53.605500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:53.659158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1162/2354] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:53.672563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:53.674935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:53.739437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf4f0-6f5c-45cb-b8d6-2d2e96c0a94c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:53.743592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:53.744241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:53.744519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:53.744791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:53.755113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:53.756574 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:53.767142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1193/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:57.737264 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:57.737763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:57.737877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:57.767125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] MFA Rules not processed for user `61a118af05b24a0d9d413834ce80a700`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:57.768370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:57.856936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1163/2356] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:57.861315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:57.870540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:57.871034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:57.877896 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edce85-4b6b-454f-8400-c605faf406a9 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:57.895435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:57.896231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:57.896516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:57.896789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:57.897494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:57.899469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:57.901443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe474-7fe8-4a81-a7c5-62f2bccff833 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:57.906860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:57.907803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:57.908082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:57.908877 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] PATH_INFO: `/v3/users/4341db78640f409a919da947393ef1ea` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:57.910538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4341db78640f409a919da947393ef1ea)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:57.912737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:57.929633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1194/2357] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:57 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:57.934442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:57.970018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4341db78640f409a919da947393ef1ea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:57.982092 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4341db78640f409a919da947393ef1ea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:57.983795 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4341db78640f409a919da947393ef1ea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:57.993498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4341db78640f409a919da947393ef1ea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:57.995206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:58.007283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7fea8e5c-9821-411e-b0b9-68a6d3e76e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4341db78640f409a919da947393ef1ea'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:58.009941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787086f-f883-4ece-ba9f-424402d29ded admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.016154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.016978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.017261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.017536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.018233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.018695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1164/2358] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:57 2022] DELETE /identity/v3/users/4341db78640f409a919da947393ef1ea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:58.020282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.023111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.023540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.023948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.044214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1195/2359] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:57 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:58.047459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:58.048037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:58.048874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:58.049965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:58.059991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:58.063645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c7ce-aeb9-424e-8989-35a20c4e3836 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.124430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1165/2360] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:58.130817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.131773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.132687 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.132976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.133793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.134320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:58.135629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.135801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:58.148557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1196/2361] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:58.153208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:58.163867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2799490-23c2-41fc-a985-5fe264b8afd7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.169023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.169922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.170199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.170464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] PATH_INFO: `/v3/projects/948c8c424d7840c79605f4db89411ec9/users/d51f582ba70d4520a95ad2c492b93641/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.188692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948c8c424d7840c79605f4db89411ec9, user_id=d51f582ba70d4520a95ad2c492b93641, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.191474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.202701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54a3c7-2309-42f4-bb52-6788d67e6fec None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.208485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1197/2362] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:58 2022] PUT /identity/v3/projects/948c8c424d7840c79605f4db89411ec9/users/d51f582ba70d4520a95ad2c492b93641/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:58.212826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:58.258146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412f7c9-84ae-4e57-8887-2e2483a419f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.258912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412f7c9-84ae-4e57-8887-2e2483a419f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.259310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412f7c9-84ae-4e57-8887-2e2483a419f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.259589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412f7c9-84ae-4e57-8887-2e2483a419f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.281762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c1ed-c7d8-448c-80ab-667548fcba28 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.286798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.287616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.287969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.288305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.288978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.290611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.306023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1198/2363] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:58.313259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:58.332639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f1db-32a0-4519-9714-619be8092349 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.338390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.339355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.339634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.339906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] PATH_INFO: `/v3/projects/948c8c424d7840c79605f4db89411ec9/users/d51f582ba70d4520a95ad2c492b93641/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.341979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948c8c424d7840c79605f4db89411ec9, user_id=d51f582ba70d4520a95ad2c492b93641, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.344697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.355186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1199/2364] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:58 2022] PUT /identity/v3/projects/948c8c424d7840c79605f4db89411ec9/users/d51f582ba70d4520a95ad2c492b93641/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:58.355496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412f7c9-84ae-4e57-8887-2e2483a419f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.357032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412f7c9-84ae-4e57-8887-2e2483a419f7 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.373138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1166/2365] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:58.840240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:58.842283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:58.891997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:58.931804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf8746-b8e3-4dad-ae04-ebd96f79d2c9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:58.937738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:58.939203 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:58.939535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:58.939853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] PATH_INFO: `/v3/projects/bcbb84957a6f47bf8ad398cc1acd1140` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:58.941268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbb84957a6f47bf8ad398cc1acd1140)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:58.943898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:58.999201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbb84957a6f47bf8ad398cc1acd1140', 'request_id': 'req-84309fac-ce42-4a71-a1eb-da2bcf8377b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:59.009536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbb84957a6f47bf8ad398cc1acd1140', 'request_id': 'req-84309fac-ce42-4a71-a1eb-da2bcf8377b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:59.016800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbb84957a6f47bf8ad398cc1acd1140', 'request_id': 'req-84309fac-ce42-4a71-a1eb-da2bcf8377b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:59.029795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] The token cache is being invalidate because project bcbb84957a6f47bf8ad398cc1acd1140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:59.029987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:59.030641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-84309fac-ce42-4a71-a1eb-da2bcf8377b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:59.032290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1200/2366] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:58 2022] DELETE /identity/v3/projects/bcbb84957a6f47bf8ad398cc1acd1140 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:59.038809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.039302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.039426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.059703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:59.060950 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:59.080314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:59.126288 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1167/2367] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:59.134405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.134711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.134980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.155427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:59.156667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:59.167633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1201/2368] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:59.172044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.185963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4376d-2bea-4dce-86a0-9ec098dd980c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.191098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.191858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.192136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.192404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.193498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:59.193498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.195242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.211960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1168/2369] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:40:59.215877 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.227674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff4add-e06a-4191-b9d8-16a402870e6b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.236816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.237524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.237682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.237922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.238685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.241011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.281664 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1202/2370] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:59 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:59.283705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.310286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469737a-d53b-41a5-93a3-f91c6f4e52dc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.395988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.396778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.397142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.397481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.398338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.400555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.425527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1169/2371] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:59 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:59.429525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.445953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc51ea-a413-43f0-9ac8-245a51cbdacf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.452909 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.453605 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.454211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.454762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.455571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.457706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.479061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1203/2372] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:59.483716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.495033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ddf6-061b-49a7-8241-5d05f746f437 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.504372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a375d3-78d0-459b-8d72-9eda9c9b0179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.505326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a375d3-78d0-459b-8d72-9eda9c9b0179 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.505692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a375d3-78d0-459b-8d72-9eda9c9b0179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.506039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a375d3-78d0-459b-8d72-9eda9c9b0179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.506898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a375d3-78d0-459b-8d72-9eda9c9b0179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.514663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a375d3-78d0-459b-8d72-9eda9c9b0179 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.530085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1170/2373] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:59.531315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.541636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b74b-202b-4885-b3f8-2ee227f6e5f8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.546651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.547709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.547984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.548251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] PATH_INFO: `/v3/projects/1401df4bb6be4c3cb6e87554befae22e/users/3d7f9c1399104bf18275daec4f6ce512/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.568117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1401df4bb6be4c3cb6e87554befae22e, user_id=3d7f9c1399104bf18275daec4f6ce512, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.570833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.623322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1204/2374] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:59 2022] PUT /identity/v3/projects/1401df4bb6be4c3cb6e87554befae22e/users/3d7f9c1399104bf18275daec4f6ce512/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:59.625394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbaf8-649f-4d86-86ba-596e15ee6828 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.625692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbaf8-649f-4d86-86ba-596e15ee6828 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.625970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffbaf8-649f-4d86-86ba-596e15ee6828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.650564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ebffbaf8-649f-4d86-86ba-596e15ee6828 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:59.651986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ebffbaf8-649f-4d86-86ba-596e15ee6828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:59.749960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1171/2375] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:59.759683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:59.761396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:59.862249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60328d99-9520-4919-bd08-075c48cdfaf3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:59.869880 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:59.870700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:59.871281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:59.871659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:59.883830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:59.885398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:59.897804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1205/2376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:41:03.530640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25dfeb-88cc-4af8-82e0-3cc2814cefdb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:03.530640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25dfeb-88cc-4af8-82e0-3cc2814cefdb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:03.530640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25dfeb-88cc-4af8-82e0-3cc2814cefdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:03.579134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cf25dfeb-88cc-4af8-82e0-3cc2814cefdb None None] MFA Rules not processed for user `d51f582ba70d4520a95ad2c492b93641`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:03.580485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cf25dfeb-88cc-4af8-82e0-3cc2814cefdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:03.610827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:03.709695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1172/2377] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:41:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:03.723547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:03.726799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:03.734499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:03.874312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c95000-e0b5-4f81-9f58-ebd6ba5bd1fd service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:03.882820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:03.884907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:03.889136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:03.889525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:03.892440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:04.026656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:04.029708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:04.064971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1206/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:41:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:41:04.203404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e44cc-e69c-4ac9-b492-e081055c0141 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:04.204056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e44cc-e69c-4ac9-b492-e081055c0141 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:04.204561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e44cc-e69c-4ac9-b492-e081055c0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:04.232120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cf4e44cc-e69c-4ac9-b492-e081055c0141 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:04.234067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cf4e44cc-e69c-4ac9-b492-e081055c0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:04.374442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1173/2379] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:41:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:04.395067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:04.398174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:04.535827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036170-9941-4f3c-a27e-e247ce4ce950 service glance] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:04.551016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:04.551016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:04.551016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:04.551016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:04.558662 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:04.566240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:04.587288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1207/2380] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:41:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:41:06.114705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:06.115316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:06.115316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:06.161340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] MFA Rules not processed for user `3d7f9c1399104bf18275daec4f6ce512`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:06.162905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:06.295744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1174/2381] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:41:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:06.300648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:06.319325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a07e1-c485-44bc-ae18-e19ba48c3049 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:06.328593 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:06.330317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:06.330837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:06.332688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:06.334475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:06.336876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:06.407146 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:06.413943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1208/2382] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:41:06 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:41:06.421358 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ffd2a-d9b7-4aeb-a762-f6d047d7ff3b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:06.575023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:06.629236 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:06.630662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:06.631210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:06.631708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:06.632675 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:06.634882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:06.665359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1175/2383] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:41:06 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:41:06.669196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:06.693176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627ac4f-76f2-4b78-a961-458303d15014 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:06.711635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:06.713178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:06.713482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:06.713760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:06.714524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:06.719550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:06.735761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1209/2384] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:41:06.737514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:06.760451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a929-413d-4dcf-9025-bfc4a449c03a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:06.790829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:06.792228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:06.792771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:06.793252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] PATH_INFO: `/v3/projects/edbfcd747f994dd483170b5f9893c6c5/users/39bc5793c6ec497b81a14a7dd474cab3/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:06.823801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbfcd747f994dd483170b5f9893c6c5, user_id=39bc5793c6ec497b81a14a7dd474cab3, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:06.837182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:06.895456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1176/2385] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:41:06 2022] PUT /identity/v3/projects/edbfcd747f994dd483170b5f9893c6c5/users/39bc5793c6ec497b81a14a7dd474cab3/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:41:06.898188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:06.923762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824a27-1158-4c81-aaf7-6f09ea68d025 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:06.969966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:07.078563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a2217-f923-4d2f-a94b-eca705610d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:07.079444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a2217-f923-4d2f-a94b-eca705610d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:07.079800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a2217-f923-4d2f-a94b-eca705610d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:07.080149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a2217-f923-4d2f-a94b-eca705610d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:07.081032 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a2217-f923-4d2f-a94b-eca705610d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:07.082747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a2217-f923-4d2f-a94b-eca705610d89 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:07.110401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1210/2386] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:41:07.112829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:07.132509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab974-9702-4458-9b07-16ac418cc152 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:07.156931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:07.158542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:07.158831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:07.159169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] PATH_INFO: `/v3/projects/edbfcd747f994dd483170b5f9893c6c5/users/39bc5793c6ec497b81a14a7dd474cab3/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:07.165200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbfcd747f994dd483170b5f9893c6c5, user_id=39bc5793c6ec497b81a14a7dd474cab3, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:07.171459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:07.199257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1177/2387] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:41:07 2022] PUT /identity/v3/projects/edbfcd747f994dd483170b5f9893c6c5/users/39bc5793c6ec497b81a14a7dd474cab3/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:41:14.436992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151307-9830-4b4e-8859-0bae803d6042 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:14.437422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151307-9830-4b4e-8859-0bae803d6042 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:14.437422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151307-9830-4b4e-8859-0bae803d6042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:14.509761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-04151307-9830-4b4e-8859-0bae803d6042 None None] MFA Rules not processed for user `39bc5793c6ec497b81a14a7dd474cab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:14.517507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-04151307-9830-4b4e-8859-0bae803d6042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:14.631690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1211/2388] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:41:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:14.645902 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:14.647797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:14.831534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ef4d-3caa-406b-b0f0-3160bdc41fa1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:14.901367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c2543-a6fe-4322-8967-8a087fca43b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:14.902070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c2543-a6fe-4322-8967-8a087fca43b8 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:14.902355 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c2543-a6fe-4322-8967-8a087fca43b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:14.902631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c2543-a6fe-4322-8967-8a087fca43b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:15.069647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c2543-a6fe-4322-8967-8a087fca43b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:15.074337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c2543-a6fe-4322-8967-8a087fca43b8 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:15.100187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1178/2389] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:41:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:41:16.851743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:16.852706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:16.853157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:16.872489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] MFA Rules not processed for user `3d7f9c1399104bf18275daec4f6ce512`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:16.873979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:16.900162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1212/2390] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:41:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:20.258442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b432c-1fbe-4543-a841-3023a1634ab8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:20.259053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b432c-1fbe-4543-a841-3023a1634ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:20.259144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b432c-1fbe-4543-a841-3023a1634ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:20.283753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-879b432c-1fbe-4543-a841-3023a1634ab8 None None] MFA Rules not processed for user `61a118af05b24a0d9d413834ce80a700`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:20.285125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-879b432c-1fbe-4543-a841-3023a1634ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:20.320517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:20.345909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1179/2391] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:41:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:21.531508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:21.533221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:21.613133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70d622-b03a-4a18-857b-8290b72f8a7b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:21.618897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:21.619641 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:21.619879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:21.620165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:21.622905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:21.641458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:21.643179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:21.655465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1213/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:41:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:41:22.997098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fae69e-42ab-43f6-8a0c-db542d69f4c6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:22.997614 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fae69e-42ab-43f6-8a0c-db542d69f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:22.997881 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fae69e-42ab-43f6-8a0c-db542d69f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:23.017490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a4fae69e-42ab-43f6-8a0c-db542d69f4c6 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:23.018742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a4fae69e-42ab-43f6-8a0c-db542d69f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:23.218938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1180/2393] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:41:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:23.236738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:23.260846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:23.314803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3e5f-307e-40d6-abe7-43f363c9026a service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:23.320630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:23.321286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:23.321562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:23.321831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:23.331363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:23.333040 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:23.341578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1214/2394] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:41:33.211022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=33 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:33.349373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=23 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:48.601105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:48.601604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:48.601708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:48.621244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:41:48.621979 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:41:48.630609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1181/2395] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:41:48.645826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:41:48.658569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59823e6-a1d0-4e0b-90e3-6db47b0d2aaf service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:41:48.665522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:41:48.666568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:41:48.666885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:41:48.667414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:41:48.678571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:41:48.680456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:41:48.689218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1215/2396] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 22:41:58.615052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:58.685797 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:02.216724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:02.218326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:02.286256 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b5f71-5a58-4a4d-a66b-c4e092d6c18f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:02.290041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb08cd-e1a8-4a01-8b2b-0d8a8c72e8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:02.290753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb08cd-e1a8-4a01-8b2b-0d8a8c72e8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:02.291073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb08cd-e1a8-4a01-8b2b-0d8a8c72e8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:02.291349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb08cd-e1a8-4a01-8b2b-0d8a8c72e8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:02.302962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb08cd-e1a8-4a01-8b2b-0d8a8c72e8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:02.304450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb08cd-e1a8-4a01-8b2b-0d8a8c72e8b0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:02.314963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1182/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:42:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:42:02.422493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:02.434115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d7e2-1fe6-4b60-b6b8-83fe410b7250 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:02.439426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20c035-8021-417d-a6db-47f6bd3cdf87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:02.440443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c035-8021-417d-a6db-47f6bd3cdf87 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:02.440781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c035-8021-417d-a6db-47f6bd3cdf87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:02.441126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20c035-8021-417d-a6db-47f6bd3cdf87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:02.511789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20c035-8021-417d-a6db-47f6bd3cdf87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:02.513881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20c035-8021-417d-a6db-47f6bd3cdf87 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:02.530463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1216/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:42:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:42:07.234730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e3ac1-ba68-4ac0-b2be-421566d1f4f0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.234730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e3ac1-ba68-4ac0-b2be-421566d1f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.234730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e3ac1-ba68-4ac0-b2be-421566d1f4f0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.236861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1183/2399] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:42:07.244741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432ee0-4f3a-47f8-af3c-d71b44a39dae None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.245161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432ee0-4f3a-47f8-af3c-d71b44a39dae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.245277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d432ee0-4f3a-47f8-af3c-d71b44a39dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.268692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5d432ee0-4f3a-47f8-af3c-d71b44a39dae None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:07.270249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5d432ee0-4f3a-47f8-af3c-d71b44a39dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:07.284772 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1217/2400] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:42:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:42:07.298556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e3ac1-ba68-4ac0-b2be-421566d1f4f0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:07.390294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e3ac1-ba68-4ac0-b2be-421566d1f4f0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:07.394926 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eef97-0ea1-4f75-ab79-047a02329aae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:07.395655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eef97-0ea1-4f75-ab79-047a02329aae service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.396105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eef97-0ea1-4f75-ab79-047a02329aae service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.396386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eef97-0ea1-4f75-ab79-047a02329aae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.407771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5eef97-0ea1-4f75-ab79-047a02329aae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:07.409495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5eef97-0ea1-4f75-ab79-047a02329aae service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:07.420725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1184/2401] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:42:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:42:07.502081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252b809-c3c0-40a2-acd8-20afbe461ec5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.502514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252b809-c3c0-40a2-acd8-20afbe461ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.502897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252b809-c3c0-40a2-acd8-20afbe461ec5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.504505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1218/2402] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:42:07.509786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653496-f565-4a02-91ef-a5b2b89c5192 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.510147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653496-f565-4a02-91ef-a5b2b89c5192 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.510489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653496-f565-4a02-91ef-a5b2b89c5192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.530592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-20653496-f565-4a02-91ef-a5b2b89c5192 None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:07.531930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-20653496-f565-4a02-91ef-a5b2b89c5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:07.539567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1185/2403] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:42:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:42:07.572312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252b809-c3c0-40a2-acd8-20afbe461ec5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:07.586150 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252b809-c3c0-40a2-acd8-20afbe461ec5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:07.592855 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148e19-0fa1-4f8f-ac02-6fb377b92f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:07.593654 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148e19-0fa1-4f8f-ac02-6fb377b92f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.594039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148e19-0fa1-4f8f-ac02-6fb377b92f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.594408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148e19-0fa1-4f8f-ac02-6fb377b92f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.604013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e148e19-0fa1-4f8f-ac02-6fb377b92f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:07.605602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e148e19-0fa1-4f8f-ac02-6fb377b92f7f service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:07.614353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1219/2404] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:42:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:42:07.988459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c53ee-fbf6-403f-9c50-ea4def7bd840 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.988742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c53ee-fbf6-403f-9c50-ea4def7bd840 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.989015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c53ee-fbf6-403f-9c50-ea4def7bd840 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:07.990541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1186/2405] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:42:07.996369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be350fc8-d455-416a-871a-91e333b720fd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:07.996661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be350fc8-d455-416a-871a-91e333b720fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:07.996948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be350fc8-d455-416a-871a-91e333b720fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:08.017450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-be350fc8-d455-416a-871a-91e333b720fd None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:08.018697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-be350fc8-d455-416a-871a-91e333b720fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:08.033438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1220/2406] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:42:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:42:08.045980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c53ee-fbf6-403f-9c50-ea4def7bd840 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:08.058892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c53ee-fbf6-403f-9c50-ea4def7bd840 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:08.062912 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:08.063599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:08.064517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:08.064517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:08.078168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:08.079694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:08.091170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1187/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:42:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:42:12.619785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c5046-8814-407a-9b9c-c6c27aa66e86 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:12.620275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c5046-8814-407a-9b9c-c6c27aa66e86 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:12.620557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c5046-8814-407a-9b9c-c6c27aa66e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:12.640334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b52c5046-8814-407a-9b9c-c6c27aa66e86 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:12.641546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b52c5046-8814-407a-9b9c-c6c27aa66e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:12.649619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1221/2408] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:42:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:42:12.661906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:12.673680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b9689-fa18-4320-bd41-20de3ba358cf service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:12.679247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e1a2-484e-4291-ac28-f7f4f40758e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:12.679886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e1a2-484e-4291-ac28-f7f4f40758e1 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:12.680168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e1a2-484e-4291-ac28-f7f4f40758e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:12.680439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e1a2-484e-4291-ac28-f7f4f40758e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:12.689099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e1a2-484e-4291-ac28-f7f4f40758e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:12.690701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e1a2-484e-4291-ac28-f7f4f40758e1 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:12.699686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1188/2409] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:42:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:42:13.486804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:13.487126 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:13.487404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:13.507038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] MFA Rules not processed for user `b4de631c92ac409f8e907807f54e516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:13.508260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:13.566348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1222/2410] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:42:22.696685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=67 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:23.560953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=70 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:39.841815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4fd23-5214-4da9-80fa-661789aa9d9c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:39.842349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4fd23-5214-4da9-80fa-661789aa9d9c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:39.842449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4fd23-5214-4da9-80fa-661789aa9d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:39.861205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bbe4fd23-5214-4da9-80fa-661789aa9d9c None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:39.862504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bbe4fd23-5214-4da9-80fa-661789aa9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:39.870836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1189/2411] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 22:42:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:42:39.885577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:42:39.899286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233290e-e848-48a0-a177-a92e2554d2eb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:42:39.904256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:42:39.904903 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:39.905180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:39.905445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:39.915037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:42:39.916686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:42:39.925362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1223/2412] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:42:49.856837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:49.921889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:57.319639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:42:57.319639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:42:57.320732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:42:57.350852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] MFA Rules not processed for user `71faa4cc60f74a089fdf763ba13f56fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:42:57.352121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:42:57.419728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1190/2413] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:42:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:43:07.411490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=25 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:34.464460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:34.474840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d22817-15be-4230-b2bb-1b0c2e1a7bd0 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:34.482736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:34.483499 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:34.483758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:34.484023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:34.486145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:34.502099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:34.503589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:34.515704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1224/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:43:35.784878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:35.795642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d5eb6-d57d-4569-8994-7f6a3155321c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:35.800373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:35.801049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:35.801351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:35.801620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:35.803841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:35.819394 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:35.820846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55a63c-e91a-4e72-a10e-5ad3093c9e9b service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:35.832441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1191/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:43:44.510373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:45.827507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:48.955987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:48.957705 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:48.973244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283116f-18a5-44c2-8bc2-6148ef3b32ed service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:48.980919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:48.981572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:48.981853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:48.982127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:48.984448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:49.048442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:49.050816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:49.062050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1225/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:43:56.413376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:56.413870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:56.413965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:56.431501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] MFA Rules not processed for user `27677feb06384469994cf5706f482e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:43:56.432708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:56.439691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1192/2417] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:43:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:43:56.771533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:56.781252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58af3c1-c6d7-427a-ba32-f5e8c5aeccc0 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:56.785487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:56.786129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:56.786409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:56.786679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:56.788625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:56.799233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:56.800643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:56.808814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1226/2418] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:43:57.134524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:57.136098 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:57.152190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a1ed2-7232-43c6-8436-001c60453a21 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:57.157377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:57.158103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:57.158389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:57.158661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:57.160613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:57.173109 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:57.174585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:57.185573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1193/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:43:59.152299 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:59.161869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5d134-2c36-402e-b442-c8aef2a6e1bd service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:59.165672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:59.166336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:59.166615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:59.166885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:59.168860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:59.179601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:59.181455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:59.190782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1227/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:43:59.820242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:59.842380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f6e19-c553-453e-907f-ec58168c79b9 service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:59.848741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:59.849702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:59.850212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:59.850554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:59.852507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:59.866405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:59.868299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:59.880867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1194/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:06.074539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:06.088217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d805-840c-41f8-9e54-461be6d2b039 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:06.093806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:06.094466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:06.094745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:06.095051 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:06.096822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:06.109620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:06.111671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:06.123009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1228/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:09.080322 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:09.082352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:09.149330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f71fb-d20c-4fe7-92eb-a5d8df91ae53 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:09.154365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:09.155182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:09.155559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:09.155927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:09.157954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:09.170014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:09.171625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441a427-b5b1-4f84-926a-db86247e5dd8 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:09.181346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1195/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:10.075469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:10.086808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee1cc3-dc16-4556-99d8-299231496cf2 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:10.092975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:10.093627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:10.094077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:10.094354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:10.096267 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:10.109506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:10.111171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:10.122828 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1229/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:19.176954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=41 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:20.117775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=52 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:30.932126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:30.932750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:30.932750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:30.951100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] MFA Rules not processed for user `b4de631c92ac409f8e907807f54e516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:44:30.952419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:30.959870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1196/2425] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:44:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:44:32.710418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:32.723400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca48b58-5898-499d-8916-5141a5acfd88 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:32.727345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:32.728526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:32.729097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:32.729790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:32.731984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:32.817830 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:32.819936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:32.847648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1230/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:36.401852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:36.415738 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddc56f-ac1a-459c-882b-c2a35f6a87e0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:36.420868 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:36.421916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:36.422376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:36.422647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:36.424652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:36.441373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:36.444630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:36.466011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1197/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:36.509112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:36.510622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:36.523123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7928-a5d2-4c03-ad76-83a026a17528 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:36.527813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:36.528768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:36.528964 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:36.529293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] PATH_INFO: `/v3/users/71faa4cc60f74a089fdf763ba13f56fa` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:36.531981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=71faa4cc60f74a089fdf763ba13f56fa)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:36.534125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:36.584962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71faa4cc60f74a089fdf763ba13f56fa'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.594719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71faa4cc60f74a089fdf763ba13f56fa'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.595868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71faa4cc60f74a089fdf763ba13f56fa'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.603066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71faa4cc60f74a089fdf763ba13f56fa'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.603685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ad432c3e-9797-49c8-8429-6ca9166906fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71faa4cc60f74a089fdf763ba13f56fa'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.620793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1231/2428] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:44:36 2022] DELETE /identity/v3/users/71faa4cc60f74a089fdf763ba13f56fa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:44:36.808543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:36.820408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d3f8-0559-49d0-887b-9f9ba81eb0bd service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:36.880542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:36.881672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:36.881948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:36.882212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] PATH_INFO: `/v3/projects/2be2fa57e1194b88a79fd1fc10ca2dd6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:36.883431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be2fa57e1194b88a79fd1fc10ca2dd6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:36.885346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:36.935806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be2fa57e1194b88a79fd1fc10ca2dd6', 'request_id': 'req-1a89b172-fc85-474e-b198-3979077e0c49'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.941954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be2fa57e1194b88a79fd1fc10ca2dd6', 'request_id': 'req-1a89b172-fc85-474e-b198-3979077e0c49'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.949590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be2fa57e1194b88a79fd1fc10ca2dd6', 'request_id': 'req-1a89b172-fc85-474e-b198-3979077e0c49'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.961659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] The token cache is being invalidate because project 2be2fa57e1194b88a79fd1fc10ca2dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:44:36.961989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.962699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1a89b172-fc85-474e-b198-3979077e0c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:44:36.964301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1198/2429] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:44:36 2022] DELETE /identity/v3/projects/2be2fa57e1194b88a79fd1fc10ca2dd6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:44:36.969471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:36.969759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:36.970030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:36.989138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:44:36.990358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:37.053661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1232/2430] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:44:37.061442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.061725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.061997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.082693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:44:37.083982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:37.092272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1199/2431] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:44:37.096851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.108982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0a619-2592-4601-899f-5f576e13e8c6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.114016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.114686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.114969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.115271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.116020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:44:37.116328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.117950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.120723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:37.132906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1233/2432] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:44:37.137626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.147897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dcd7f-feb2-4d93-aab9-b4001e20ae8c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.152984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.153624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.153906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.154240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.154960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.156914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.183899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1200/2433] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:44:37 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:44:37.188359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.198228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a157a2-876a-461a-b2bc-c4e6bb407713 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.258648 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.259374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.259658 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.259933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.260655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.262609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.283644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1234/2434] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:44:37 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:44:37.287932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.298617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d251e-d1fc-45f0-bc67-cd8f8abc0679 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.303842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.304508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.304781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.305056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.305780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.307468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.318811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1201/2435] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:44:37.323206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.334764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff744-0320-438c-8662-ec67fc79e90c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.341228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24070c9-53a3-454b-8c8d-73a6833ae83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.341963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24070c9-53a3-454b-8c8d-73a6833ae83a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.342242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24070c9-53a3-454b-8c8d-73a6833ae83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.342517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24070c9-53a3-454b-8c8d-73a6833ae83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.343293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24070c9-53a3-454b-8c8d-73a6833ae83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.344902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24070c9-53a3-454b-8c8d-73a6833ae83a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.360313 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1235/2436] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:44:37.365313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.376699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448b632-1677-4be4-9d39-a8a59336e6a9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.381811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.382704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.382976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.383269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] PATH_INFO: `/v3/projects/fd304e10901a4579939ab5f57171eae0/users/c9eeca4826c344c5bb62eec21ccba6f5/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.399333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd304e10901a4579939ab5f57171eae0, user_id=c9eeca4826c344c5bb62eec21ccba6f5, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.402023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.418335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1202/2437] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:44:37 2022] PUT /identity/v3/projects/fd304e10901a4579939ab5f57171eae0/users/c9eeca4826c344c5bb62eec21ccba6f5/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:44:37.423596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a244a2-3326-4067-ba7a-01934b8624d9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.423918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a244a2-3326-4067-ba7a-01934b8624d9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.424196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a244a2-3326-4067-ba7a-01934b8624d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.442483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-50a244a2-3326-4067-ba7a-01934b8624d9 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:44:37.443656 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50a244a2-3326-4067-ba7a-01934b8624d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:37.506610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1236/2438] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:44:37.517141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:37.519089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:37.529292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:37.598763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa2eb0-3a3f-4cb1-9030-6956f893a026 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:37.604559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:37.604559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:37.604559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:37.604559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:37.617330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:37.619578 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:37.630744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1203/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:41.861537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cea5ab-5a2d-4c45-9b43-b673542bb142 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:41.862036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cea5ab-5a2d-4c45-9b43-b673542bb142 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:41.862155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cea5ab-5a2d-4c45-9b43-b673542bb142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:41.890709 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-87cea5ab-5a2d-4c45-9b43-b673542bb142 None None] MFA Rules not processed for user `c9eeca4826c344c5bb62eec21ccba6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:44:41.892427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-87cea5ab-5a2d-4c45-9b43-b673542bb142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:41.959168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1237/2440] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:44:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:44:41.977111 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:41.978743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:42.061230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4884e-9bc4-4bb9-8932-3955cb40f501 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:42.072276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:42.072923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:42.073203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:42.073471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:42.082583 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:42.084231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:42.093857 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1204/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:44:43.627727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:43.628221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:43.628447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:43.634937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:43.650199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] MFA Rules not processed for user `c9eeca4826c344c5bb62eec21ccba6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:44:43.651471 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:43.658790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1238/2442] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:44:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:44:43.929844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:43.940180 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c618-143b-4562-bb83-b2cad94ec908 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:43.943995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:43.944666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:43.944944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:43.945216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:43.947063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:43.982420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:44:43.993900 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78389825-f838-4c6a-b6b1-b88fcf4f8dd4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:44:43.997602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:44:43.998469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:44:43.998783 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:44:43.999244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:44:44.001879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:44:44.012488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:44.014206 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef73f1-3b64-4f87-9e21-667be405716d service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:44.014890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:44:44.016870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f086e-6738-49eb-b308-da62d3e137f6 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:44:44.023899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1239/2443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:44.030812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1205/2444] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:44:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:54.019731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=8 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:54.023827 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=85 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:02.914823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5839-7fb7-48df-938b-99e0b119c8e1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:02.915408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5839-7fb7-48df-938b-99e0b119c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:02.915490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5839-7fb7-48df-938b-99e0b119c8e1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:02.916836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1240/2445] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:45:02.923309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176dc6-c661-4856-9199-44d0fe26abd5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:02.923860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176dc6-c661-4856-9199-44d0fe26abd5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:02.923860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176dc6-c661-4856-9199-44d0fe26abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:02.942032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-51176dc6-c661-4856-9199-44d0fe26abd5 None None] MFA Rules not processed for user `8255eebd418f42b28a810c7d9e86162f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:45:02.943272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-51176dc6-c661-4856-9199-44d0fe26abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:02.949812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1206/2446] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:45:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:45:02.962961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5839-7fb7-48df-938b-99e0b119c8e1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:02.974234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5839-7fb7-48df-938b-99e0b119c8e1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:02.977753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b714fc-5cef-4fb2-9b46-d910887dfd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:02.978396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b714fc-5cef-4fb2-9b46-d910887dfd28 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:02.978672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b714fc-5cef-4fb2-9b46-d910887dfd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:02.979297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b714fc-5cef-4fb2-9b46-d910887dfd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:02.988558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b714fc-5cef-4fb2-9b46-d910887dfd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:02.990246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b714fc-5cef-4fb2-9b46-d910887dfd28 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:03.000741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1241/2447] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:45:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:45:03.100151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03142-e973-49c7-99f0-a6f2e358de5c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:03.100438 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03142-e973-49c7-99f0-a6f2e358de5c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:03.100711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03142-e973-49c7-99f0-a6f2e358de5c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:03.102107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1207/2448] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 22:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:45:03.108095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db330-af11-4835-a912-a46e141cb586 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:03.108424 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db330-af11-4835-a912-a46e141cb586 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:03.108699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db330-af11-4835-a912-a46e141cb586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:03.127620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-998db330-af11-4835-a912-a46e141cb586 None None] MFA Rules not processed for user `d1ef9948ee7a4b2b86b823b7e97a7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:45:03.128934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-998db330-af11-4835-a912-a46e141cb586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:03.140193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1242/2449] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 22:45:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:45:03.158208 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03142-e973-49c7-99f0-a6f2e358de5c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:03.171101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03142-e973-49c7-99f0-a6f2e358de5c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:03.186662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:03.187535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:03.188037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:03.188490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:03.205757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:03.207981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:03.222421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1208/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:45:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:45:03.240825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:03.241116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:03.241391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:03.260009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:45:03.261515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:03.321490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1243/2451] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 22:45:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:45:03.372521 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:03.374173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:03.446346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e35dd-6639-4f86-a0ef-63371c1f8d4e service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:03.451947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:03.452717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:03.453081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:03.453441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:03.463444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:03.465059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:03.473914 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1209/2452] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:45:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:45:11.129916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:11.132133 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:11.194364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:11.196124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:11.218628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8976fa-cc6a-42b5-806d-b41a652941e7 service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:11.230490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:11.231418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:11.231699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:11.231967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] PATH_INFO: `/v3/users/61a118af05b24a0d9d413834ce80a700` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:11.233171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a118af05b24a0d9d413834ce80a700)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:11.235375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:11.243985 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6d155-a7eb-4460-8634-b9ce4f4dd3bb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:11.251616 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:11.252569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:11.252849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:11.253426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:11.256175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:11.270386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:11.272064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:11.285172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1244/2453] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:45:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:45:11.299218 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a118af05b24a0d9d413834ce80a700'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.317449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a118af05b24a0d9d413834ce80a700'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.319569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a118af05b24a0d9d413834ce80a700'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.329818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a118af05b24a0d9d413834ce80a700'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.343575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a118af05b24a0d9d413834ce80a700'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.350009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1210/2454] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:45:11 2022] DELETE /identity/v3/users/61a118af05b24a0d9d413834ce80a700 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:45:11.545247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:11.556924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e51e9-f31e-4dae-961a-e19cceb2b39b service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:11.619145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:11.620030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:11.620296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:11.620568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] PATH_INFO: `/v3/projects/fdfac224c1ba4334acdad787449adafa` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:11.621814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfac224c1ba4334acdad787449adafa)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:11.623760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:11.641278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:11.675145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfac224c1ba4334acdad787449adafa', 'request_id': 'req-7b316d67-52fc-4443-907a-bd96582ca3dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.683207 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfac224c1ba4334acdad787449adafa', 'request_id': 'req-7b316d67-52fc-4443-907a-bd96582ca3dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.688987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfac224c1ba4334acdad787449adafa', 'request_id': 'req-7b316d67-52fc-4443-907a-bd96582ca3dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.700284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] The token cache is being invalidate because project fdfac224c1ba4334acdad787449adafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:45:11.700575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.701225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.702826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1245/2455] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:45:11 2022] DELETE /identity/v3/projects/fdfac224c1ba4334acdad787449adafa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:45:11.706895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:11.708446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:11.721624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceb25e-5cc9-4b74-93fb-d7288b67c774 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:11.764220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:11.785117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:11.786423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:11.786837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:11.787289 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] PATH_INFO: `/v3/users/d51f582ba70d4520a95ad2c492b93641` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:11.788921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51f582ba70d4520a95ad2c492b93641)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:11.791879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:11.848477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51f582ba70d4520a95ad2c492b93641'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.856404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51f582ba70d4520a95ad2c492b93641'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.857347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51f582ba70d4520a95ad2c492b93641'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.864471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51f582ba70d4520a95ad2c492b93641'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.876477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c5b8c544-33f4-42da-95f7-8442cb26326f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51f582ba70d4520a95ad2c492b93641'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:11.882554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1211/2456] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:45:11 2022] DELETE /identity/v3/users/d51f582ba70d4520a95ad2c492b93641 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:45:12.061721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:45:12.063310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:45:12.082359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316d67-52fc-4443-907a-bd96582ca3dc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:45:12.143263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:45:12.144185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:45:12.144458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:45:12.144753 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] PATH_INFO: `/v3/projects/948c8c424d7840c79605f4db89411ec9` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:45:12.146037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948c8c424d7840c79605f4db89411ec9)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:45:12.148011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:45:12.201023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948c8c424d7840c79605f4db89411ec9', 'request_id': 'req-4692b218-8b3d-4102-80fc-d5e7304cf969'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:12.208696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948c8c424d7840c79605f4db89411ec9', 'request_id': 'req-4692b218-8b3d-4102-80fc-d5e7304cf969'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:12.214879 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948c8c424d7840c79605f4db89411ec9', 'request_id': 'req-4692b218-8b3d-4102-80fc-d5e7304cf969'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:12.225760 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] The token cache is being invalidate because project 948c8c424d7840c79605f4db89411ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:45:12.226041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:12.226666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:45:12.228236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1246/2457] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:45:12 2022] DELETE /identity/v3/projects/948c8c424d7840c79605f4db89411ec9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:45:21.879209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:22.223065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:00.555086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04244-eb0c-4d0f-8ed8-36149d7ea4c6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:00.555631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04244-eb0c-4d0f-8ed8-36149d7ea4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:00.555631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e04244-eb0c-4d0f-8ed8-36149d7ea4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:00.576661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e6e04244-eb0c-4d0f-8ed8-36149d7ea4c6 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:46:00.578424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e6e04244-eb0c-4d0f-8ed8-36149d7ea4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:00.645328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1212/2458] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:46:00.657750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:46:00.659333 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:00.732706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692b218-8b3d-4102-80fc-d5e7304cf969 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:46:00.738659 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:46:00.739361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:00.739634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:00.739906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:00.748827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:46:00.750420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:46:00.758578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1247/2459] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:46:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:46:10.637887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=25 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:10.755166 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=32 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:21.780552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:21.781038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:21.781137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:21.819433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:46:21.820653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:21.858723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1213/2460] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:46:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:46:21.871342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:46:21.915102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef6411-c693-4d3a-8ba4-059ef13ff903 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:46:21.921044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0284d-6085-44df-a2f7-95578cedd215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:46:21.921746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0284d-6085-44df-a2f7-95578cedd215 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:21.922031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0284d-6085-44df-a2f7-95578cedd215 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:21.922306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0284d-6085-44df-a2f7-95578cedd215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:21.931152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0284d-6085-44df-a2f7-95578cedd215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:46:21.932802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0284d-6085-44df-a2f7-95578cedd215 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:46:21.941642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1248/2461] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:46:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:46:31.856441 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=23 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:31.937942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=20 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:37.564696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:46:37.566841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:37.669822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38339c84-e4e8-44f2-a88b-c0089c49be17 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:46:37.675380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:46:37.676120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:37.676396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:37.676667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:37.678459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:37.690198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:46:37.691850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c572a5-4ff9-4c73-98da-a1ea0f3039b9 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:46:37.702737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1214/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:46:41.202908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:41.203444 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:41.203543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:41.221812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] MFA Rules not processed for user `b4de631c92ac409f8e907807f54e516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:46:41.223074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:41.281778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1249/2463] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:46:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:46:43.472693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:43.473176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:43.473280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:43.492057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:46:43.493407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:46:43.501036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1215/2464] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 22:46:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:46:43.515152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:46:43.532347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195aa8-ee36-4771-a0d2-d56f56fa20ab None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:46:43.537537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:46:43.538188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:46:43.538468 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:46:43.538742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:46:43.547335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:46:43.548959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:46:43.558400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1250/2465] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:46:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:46:53.487214 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=44 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:53.554645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=31 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:04.024730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:04.026391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:04.113850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad7a23-249e-437a-b79e-0e0fef07af7f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:04.118105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:04.118760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:04.119048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:04.119348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:04.121333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:04.193953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:04.195450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:04.204757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1216/2466] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:47:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:47:09.049425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:09.051628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:09.064474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ce59-a6d8-432d-ad7c-68b5a121f05d service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:09.068132 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:09.068850 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:09.069212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:09.069567 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:09.071437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:09.167914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:09.169380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:09.189642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1251/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:47:14.201235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=57 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:15.608790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:15.610405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:15.625584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a394a5-8e04-4bd4-b9bd-fda212aa2061 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:15.632261 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:15.633574 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:15.633933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:15.634284 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] PATH_INFO: `/v3/users/3d7f9c1399104bf18275daec4f6ce512` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:15.636286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7f9c1399104bf18275daec4f6ce512)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:15.638878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:15.695295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7f9c1399104bf18275daec4f6ce512'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:15.704511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7f9c1399104bf18275daec4f6ce512'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:15.705132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7f9c1399104bf18275daec4f6ce512'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:15.712588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7f9c1399104bf18275daec4f6ce512'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:15.725194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7f9c1399104bf18275daec4f6ce512'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:15.731562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1217/2468] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:47:15 2022] DELETE /identity/v3/users/3d7f9c1399104bf18275daec4f6ce512 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:47:15.929665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:15.939804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceafe5-1c03-4d21-828c-abab5130682f service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:15.999440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:16.000335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:16.000620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:16.000897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] PATH_INFO: `/v3/projects/1401df4bb6be4c3cb6e87554befae22e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:16.002674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1401df4bb6be4c3cb6e87554befae22e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:16.005897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:16.058630 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1401df4bb6be4c3cb6e87554befae22e', 'request_id': 'req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.066048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1401df4bb6be4c3cb6e87554befae22e', 'request_id': 'req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.071799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1401df4bb6be4c3cb6e87554befae22e', 'request_id': 'req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.073714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:16.085086 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] The token cache is being invalidate because project 1401df4bb6be4c3cb6e87554befae22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:47:16.085382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.086430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.088223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1252/2469] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:47:15 2022] DELETE /identity/v3/projects/1401df4bb6be4c3cb6e87554befae22e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:47:16.092395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:16.094007 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:16.107352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea6885-b5f7-41bb-ba3d-6c1d17869887 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:16.173975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:16.174769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:16.175099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:16.175379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] PATH_INFO: `/v3/users/39bc5793c6ec497b81a14a7dd474cab3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:16.176690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bc5793c6ec497b81a14a7dd474cab3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:16.178644 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:16.226249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bc5793c6ec497b81a14a7dd474cab3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.234985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bc5793c6ec497b81a14a7dd474cab3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.235706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bc5793c6ec497b81a14a7dd474cab3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.243370 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bc5793c6ec497b81a14a7dd474cab3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.251282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:16.256951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bc5793c6ec497b81a14a7dd474cab3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.264592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1218/2470] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:47:16 2022] DELETE /identity/v3/users/39bc5793c6ec497b81a14a7dd474cab3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:47:16.460831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:16.462359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:16.475626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f23f44-5b3c-403c-83a8-8f1f412c0eb4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:16.534001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:16.534947 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:16.535284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:16.535550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] PATH_INFO: `/v3/projects/edbfcd747f994dd483170b5f9893c6c5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:16.536875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbfcd747f994dd483170b5f9893c6c5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:16.538844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:16.587617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbfcd747f994dd483170b5f9893c6c5', 'request_id': 'req-28dd7c42-d628-475e-9e81-1d12736e1712'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.596306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbfcd747f994dd483170b5f9893c6c5', 'request_id': 'req-28dd7c42-d628-475e-9e81-1d12736e1712'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.601977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbfcd747f994dd483170b5f9893c6c5', 'request_id': 'req-28dd7c42-d628-475e-9e81-1d12736e1712'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.613816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] The token cache is being invalidate because project edbfcd747f994dd483170b5f9893c6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:47:16.614102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.614744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:16.616377 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1253/2471] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:47:16 2022] DELETE /identity/v3/projects/edbfcd747f994dd483170b5f9893c6c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:47:26.265102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:26.610938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:55.966182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:55.967861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:56.029982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1962370-d0d4-48d6-abc7-6c37b53f9262 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:56.102816 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:56.103405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:56.103685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:56.103958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:56.106138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:56.175093 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:56.176545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:56.187639 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1219/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:47:59.373858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:59.376153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:59.392014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7c42-d628-475e-9e81-1d12736e1712 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:59.396588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:59.397849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:59.398158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:59.398433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] PATH_INFO: `/v3/users/27677feb06384469994cf5706f482e09` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:59.399676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27677feb06384469994cf5706f482e09)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:59.401617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:59.450367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27677feb06384469994cf5706f482e09'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.459202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27677feb06384469994cf5706f482e09'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.459824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27677feb06384469994cf5706f482e09'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.467167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27677feb06384469994cf5706f482e09'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.467814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d125373c-ea5c-4d35-bc83-b03b0a42b8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27677feb06384469994cf5706f482e09'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.489867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1254/2473] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:47:59 2022] DELETE /identity/v3/users/27677feb06384469994cf5706f482e09 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:47:59.673854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:47:59.684535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee5f2-6828-4037-aca5-63db0c20c653 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:47:59.743796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:47:59.744823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:59.745103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:59.745371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] PATH_INFO: `/v3/projects/6b1cc5366ebc4cdd858e4e847d384ab4` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:59.746656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1cc5366ebc4cdd858e4e847d384ab4)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:47:59.748605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:47:59.756372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:59.796054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1cc5366ebc4cdd858e4e847d384ab4', 'request_id': 'req-05160516-56e1-4c76-a74e-2e205b2ab2b9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.801655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1cc5366ebc4cdd858e4e847d384ab4', 'request_id': 'req-05160516-56e1-4c76-a74e-2e205b2ab2b9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.809699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1cc5366ebc4cdd858e4e847d384ab4', 'request_id': 'req-05160516-56e1-4c76-a74e-2e205b2ab2b9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.822709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] The token cache is being invalidate because project 6b1cc5366ebc4cdd858e4e847d384ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:47:59.822967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.823756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-05160516-56e1-4c76-a74e-2e205b2ab2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:47:59.825420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1220/2474] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:47:59 2022] DELETE /identity/v3/projects/6b1cc5366ebc4cdd858e4e847d384ab4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:47:59.831537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:59.832021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:59.832490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:59.896005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:47:59.897525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:59.959464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1255/2475] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:47:59.967750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:47:59.968036 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:47:59.968316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:47:59.988651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:47:59.989858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:47:59.998497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1221/2476] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:00.002798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.013078 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62af856-bd01-479b-9a3a-c570e5dd887a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.018829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.019555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.019831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.020103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.020834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:00.021141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.023152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.035935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1256/2477] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:48:00.040514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.052839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bd1a-0a2b-4ef1-8f16-2a4655b732b7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.058712 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.059427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.059705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.059972 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.060665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.062581 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.091599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1222/2478] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:00 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:00.096454 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.110143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2bfc6-4080-402c-9049-00ad5d6474f7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.137280 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:00.170536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.171179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.171460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.171731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.172427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.174357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.196588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1257/2479] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:00 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:00.200793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.211662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89cf44-7174-48fd-a883-c0410bcb51fa admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.217232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.217897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.218179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.218455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.219240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.220836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.232314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1223/2480] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:00.236556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.247102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06a4c7-b7bc-4417-bb65-e2135d05e328 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.253399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3f11f-e493-4dc7-82f6-d74d0f840e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.254072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f11f-e493-4dc7-82f6-d74d0f840e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.254352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f11f-e493-4dc7-82f6-d74d0f840e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.254625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f11f-e493-4dc7-82f6-d74d0f840e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.255383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3f11f-e493-4dc7-82f6-d74d0f840e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.257000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3f11f-e493-4dc7-82f6-d74d0f840e9c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.268515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1258/2481] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:00.273193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.283952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5c8ee-c75c-48ad-80e7-1ae9f15f95b8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.289787 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.290672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.290951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.291252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] PATH_INFO: `/v3/projects/40cec3f5f755452d80a62ee2806d7dfb/users/38526d95da764b31a88a6060996f7187/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.306730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cec3f5f755452d80a62ee2806d7dfb, user_id=38526d95da764b31a88a6060996f7187, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.309548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.324163 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1224/2482] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:00 2022] PUT /identity/v3/projects/40cec3f5f755452d80a62ee2806d7dfb/users/38526d95da764b31a88a6060996f7187/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:00.334491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.334777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.335065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.364123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] MFA Rules not processed for user `38526d95da764b31a88a6060996f7187`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:00.365340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:00.432201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1259/2483] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:00.436939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.499117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187f289-b7bc-4167-a04c-676476da7490 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.504397 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.505057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.505316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.505618 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.506300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.508262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.539107 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1225/2484] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:00.543301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.554370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd130e3d-28a3-4669-b120-35dfc975738e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.615865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.616745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.617021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.617339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.618360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.621416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.644139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1260/2485] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:00 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:00.648456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.659451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f6ef-c4c6-4c44-aa4c-d340ecc210b7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.664733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.665402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.665731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.666017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.666745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.668435 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.680403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1226/2486] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:00.685490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.698962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41ea4-94c0-4182-933a-65acf59c52b8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.704321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.705218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.705497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.705767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] PATH_INFO: `/v3/projects/c596381bff944abdbceb690bba2254f2/users/a180ebf0dacd42b28485ce9858eec3fd/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.721861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c596381bff944abdbceb690bba2254f2, user_id=a180ebf0dacd42b28485ce9858eec3fd, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.724581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.741612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1261/2487] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:00 2022] PUT /identity/v3/projects/c596381bff944abdbceb690bba2254f2/users/a180ebf0dacd42b28485ce9858eec3fd/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:00.745938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.756858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729958-ad78-40e6-84a2-f476b8826024 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.760861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:00.817126 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42ba8a-eca2-453d-bf33-32f57ffb7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.817810 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ba8a-eca2-453d-bf33-32f57ffb7abc admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.818096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ba8a-eca2-453d-bf33-32f57ffb7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.818371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ba8a-eca2-453d-bf33-32f57ffb7abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.819407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42ba8a-eca2-453d-bf33-32f57ffb7abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.821067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42ba8a-eca2-453d-bf33-32f57ffb7abc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.831387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1227/2488] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:00.835823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:00.841677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:00.847781 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20d972-3c30-4992-ab18-7068ec42e803 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:00.853546 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:00.854448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.854731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.855011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] PATH_INFO: `/v3/projects/c596381bff944abdbceb690bba2254f2/users/a180ebf0dacd42b28485ce9858eec3fd/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.857266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c596381bff944abdbceb690bba2254f2, user_id=a180ebf0dacd42b28485ce9858eec3fd, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:00.859966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:00.870405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1262/2489] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:00 2022] PUT /identity/v3/projects/c596381bff944abdbceb690bba2254f2/users/a180ebf0dacd42b28485ce9858eec3fd/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:00.881974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:00.882232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:00.882530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:00.908703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] MFA Rules not processed for user `a180ebf0dacd42b28485ce9858eec3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:00.909907 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:00.996003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1228/2490] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:01.007749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:01.009818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:01.110981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f8c7-061c-4e5d-9849-ce6dd37e92cd admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:01.116016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:01.116677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:01.116961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:01.117234 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:01.128011 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:01.129511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:01.140493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1263/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:01.217811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:01.228464 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc108c-900e-45c5-9042-44994a6adc8d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:01.232399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:01.233045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:01.233324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:01.233594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:01.291653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:01.293096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:01.303065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1229/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:11.135291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:11.298871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:26.902339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:26.903813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:26.960104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2a441-fc98-4b9d-9db3-40bd40a1cd9c service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:26.964292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:26.964949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:26.965248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:26.965511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:26.967717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:27.038851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:27.040400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:27.050699 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1264/2493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:30.058822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.060608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:30.077314 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aac72-81bc-4b9f-b6be-c8603767ede9 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.081760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.082905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.083215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.083485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] PATH_INFO: `/v3/users/b4de631c92ac409f8e907807f54e516e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.084698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4de631c92ac409f8e907807f54e516e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.086661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.133790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4de631c92ac409f8e907807f54e516e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.143233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4de631c92ac409f8e907807f54e516e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.144009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4de631c92ac409f8e907807f54e516e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.151650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4de631c92ac409f8e907807f54e516e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.163830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-61534956-c885-48bb-bcb3-dd02dad94813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4de631c92ac409f8e907807f54e516e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.169852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1230/2494] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:30 2022] DELETE /identity/v3/users/b4de631c92ac409f8e907807f54e516e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:30.349622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.359741 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c7f7-020d-49aa-addb-4bbc349c26b1 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.430293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.431217 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.431502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.431775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] PATH_INFO: `/v3/projects/691d65199bba4c63b78ceaa2ad6dcf5f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.432976 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=691d65199bba4c63b78ceaa2ad6dcf5f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.434883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.483396 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691d65199bba4c63b78ceaa2ad6dcf5f', 'request_id': 'req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.485946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:30.492715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691d65199bba4c63b78ceaa2ad6dcf5f', 'request_id': 'req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.499629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691d65199bba4c63b78ceaa2ad6dcf5f', 'request_id': 'req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.510973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] The token cache is being invalidate because project 691d65199bba4c63b78ceaa2ad6dcf5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:30.511301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.512020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7e8a049b-50e4-4d76-8ff9-588d8a6cc64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:30.513680 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1265/2495] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:30 2022] DELETE /identity/v3/projects/691d65199bba4c63b78ceaa2ad6dcf5f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:30.518971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.519287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.519590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.539135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:30.540362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:30.603744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1231/2496] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:30.613653 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.614243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.616018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.636775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:30.638073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:30.648176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1266/2497] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:30.651590 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.664042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f690ea-cc08-4643-86df-a3d966fd26cf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.668768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.669450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.669734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.670160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.670900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:30.671295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.675763 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.693243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1232/2498] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:30.694347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.708451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04aba2-e7ea-4d8c-a908-f0cc5b57f090 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.715066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.716302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.716832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.717251 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.718283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.720562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.765231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1267/2499] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:30 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:30.769748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.781158 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924aaf-cf5d-4468-8fdc-80b917600d2a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.847147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.847838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.848119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.848391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.849171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.851376 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.858731 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:30.879408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1233/2500] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:30 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:30.883197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.898861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eea5e3-a274-41c8-9bc4-330469337cbe admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.904507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.905504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.905785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.906058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.906802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.908710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.920336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1268/2501] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:30.924759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.936680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309d8c-c627-4dbb-81ea-035c7e9af68b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.941525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99096d6-40f0-47b7-b123-1b8028da473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.942271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99096d6-40f0-47b7-b123-1b8028da473d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.942601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99096d6-40f0-47b7-b123-1b8028da473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.943065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99096d6-40f0-47b7-b123-1b8028da473d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.943850 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99096d6-40f0-47b7-b123-1b8028da473d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.945701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99096d6-40f0-47b7-b123-1b8028da473d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:30.957498 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1234/2502] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:30.961613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:30.972155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bb39-b07a-4896-89ab-ab2ba78b3f55 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:30.977342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:30.978392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:30.978679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:30.978951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] PATH_INFO: `/v3/projects/64bd6358e0f14f3980baf7ab85abb03a/users/1a0669a33c1f4d25b923814abe519829/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:30.995505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bd6358e0f14f3980baf7ab85abb03a, user_id=1a0669a33c1f4d25b923814abe519829, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:30.998124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:31.015070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1269/2503] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:30 2022] PUT /identity/v3/projects/64bd6358e0f14f3980baf7ab85abb03a/users/1a0669a33c1f4d25b923814abe519829/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:31.026143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.026433 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.026719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.055987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:31.057693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.058056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] MFA Rules not processed for user `1a0669a33c1f4d25b923814abe519829`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:31.059283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.122677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46a38-e597-420c-a333-06a9cd7f7d45 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:31.127243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1235/2504] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:31.128149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:31.129073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.129353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.129624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] PATH_INFO: `/v3/users/38526d95da764b31a88a6060996f7187` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.130901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38526d95da764b31a88a6060996f7187)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:31.133008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:31.138707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:31.140121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.187315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38526d95da764b31a88a6060996f7187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.200511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38526d95da764b31a88a6060996f7187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.201284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38526d95da764b31a88a6060996f7187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.210210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38526d95da764b31a88a6060996f7187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.210895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e373917-090c-4e5f-a786-198f378a0330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38526d95da764b31a88a6060996f7187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.216833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:31.235061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1270/2505] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:31 2022] DELETE /identity/v3/users/38526d95da764b31a88a6060996f7187 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:31.239147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.239543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.239824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.260127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:31.261361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.262605 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e884c-8a9b-4098-b32d-332a68eb933f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:31.312823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:31.329322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1271/2506] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:31.334575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:31.335364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.335643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.335921 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.337720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.339088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:31.340388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.410332 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:31.413145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:31.413386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e7fca-a24d-4c67-bc82-577e4fe6712b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:31.418942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:31.419906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.420355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.420747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.427406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1236/2507] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:31.432620 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:31.434271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:31.447085 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1272/2508] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:31.734009 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:31.735668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:31.754310 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b44c-af58-4cdf-bf1b-51eb4ac8cd31 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:31.764495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:31.765585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.766034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.766458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] PATH_INFO: `/v3/projects/40cec3f5f755452d80a62ee2806d7dfb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.769422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cec3f5f755452d80a62ee2806d7dfb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:31.771506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:31.834287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cec3f5f755452d80a62ee2806d7dfb', 'request_id': 'req-0be47b23-d27f-40cd-92ef-35ae95ada0c1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.840178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cec3f5f755452d80a62ee2806d7dfb', 'request_id': 'req-0be47b23-d27f-40cd-92ef-35ae95ada0c1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.849695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cec3f5f755452d80a62ee2806d7dfb', 'request_id': 'req-0be47b23-d27f-40cd-92ef-35ae95ada0c1'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.866769 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] The token cache is being invalidate because project 40cec3f5f755452d80a62ee2806d7dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:31.867190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.868124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:31.870460 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1237/2509] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:31 2022] DELETE /identity/v3/projects/40cec3f5f755452d80a62ee2806d7dfb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:31.876643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:31.888757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d15b9-02a4-4986-93d6-2189db27acde service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:31.955892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:31.956824 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:31.957104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:31.957368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] PATH_INFO: `/v3/users/a180ebf0dacd42b28485ce9858eec3fd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:31.958767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a180ebf0dacd42b28485ce9858eec3fd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:31.960788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:31.999329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:32.012325 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a180ebf0dacd42b28485ce9858eec3fd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.021400 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a180ebf0dacd42b28485ce9858eec3fd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.021978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a180ebf0dacd42b28485ce9858eec3fd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.032356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a180ebf0dacd42b28485ce9858eec3fd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.033162 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6abe1f1a-cac8-43fb-82a9-b627330490ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a180ebf0dacd42b28485ce9858eec3fd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.052777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1273/2510] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:31 2022] DELETE /identity/v3/users/a180ebf0dacd42b28485ce9858eec3fd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:32.333598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.335118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:32.351529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be47b23-d27f-40cd-92ef-35ae95ada0c1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.412134 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.413013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.413348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.413621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] PATH_INFO: `/v3/projects/c596381bff944abdbceb690bba2254f2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.414821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c596381bff944abdbceb690bba2254f2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.416773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.425224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:32.467196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c596381bff944abdbceb690bba2254f2', 'request_id': 'req-acfdc225-a302-40b3-ac4e-8fec4858b10b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.473860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c596381bff944abdbceb690bba2254f2', 'request_id': 'req-acfdc225-a302-40b3-ac4e-8fec4858b10b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.484656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c596381bff944abdbceb690bba2254f2', 'request_id': 'req-acfdc225-a302-40b3-ac4e-8fec4858b10b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.501025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] The token cache is being invalidate because project c596381bff944abdbceb690bba2254f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:32.501459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.502539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-acfdc225-a302-40b3-ac4e-8fec4858b10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:32.505032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1238/2511] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:32 2022] DELETE /identity/v3/projects/c596381bff944abdbceb690bba2254f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:32.511017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.511502 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.511637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.533036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:32.534243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:32.603247 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1274/2512] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:32.611319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.611600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.611874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.631339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:32.632612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:32.643659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1239/2513] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:32.648482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.658785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d4cab-5a52-4025-aab0-91e7bbc02dea None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.663936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.664589 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.664866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.665139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.665865 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:32.666169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.667820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.679770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1275/2514] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:32.684161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.694011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309dc4-6a63-48ac-b511-9a95c8105e62 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.699539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.700184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.700481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.700751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.701445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.703395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.731796 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1240/2515] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:32 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:32.737816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.748763 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5baaf-6898-4e6b-89a6-b3c78b869c88 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.812235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.812821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.813092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.813363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.814055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.816091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.839935 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1276/2516] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:32 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:32.844674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.857799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c9c35-bbec-4f92-b929-c6c2d951d595 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.863456 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.864128 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.864402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.864938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.865378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.867130 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.878876 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1241/2517] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:32.883873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.900586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83e5c-fcdb-4cc3-93cf-b7b0ac8b99e1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.907646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c94f1a-0e4e-4262-8842-d8c1934709ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.908670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94f1a-0e4e-4262-8842-d8c1934709ab admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.909144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94f1a-0e4e-4262-8842-d8c1934709ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.909592 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94f1a-0e4e-4262-8842-d8c1934709ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.910891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c94f1a-0e4e-4262-8842-d8c1934709ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.913692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c94f1a-0e4e-4262-8842-d8c1934709ab admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.926105 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1277/2518] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:32.930489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:32.941230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831c76c-92d6-46fe-a1af-f7aaaa1ae9fe admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:32.946594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:32.947508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.947777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.948061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] PATH_INFO: `/v3/projects/4f5d8195cacf4d149eee49367e23c7ff/users/bb700d8e2c0a4e09b0d8edd2f3609df9/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:32.963909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5d8195cacf4d149eee49367e23c7ff, user_id=bb700d8e2c0a4e09b0d8edd2f3609df9, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:32.966601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:32.990356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1242/2519] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:32 2022] PUT /identity/v3/projects/4f5d8195cacf4d149eee49367e23c7ff/users/bb700d8e2c0a4e09b0d8edd2f3609df9/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:32.993263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:32.993545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:32.993814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.021421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] MFA Rules not processed for user `bb700d8e2c0a4e09b0d8edd2f3609df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:33.022703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:33.027154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:33.097732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1278/2520] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:33.102412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.176396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234509b-1d19-4751-9754-c848e95a6e78 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.181898 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.182598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.182884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.183194 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.184017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.186518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.216542 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1243/2521] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:33 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:33.220878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.232508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beeff3-f629-4331-82a8-fd295c3ddb7a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.292988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.293666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.293943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.294246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.294949 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.296948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.318950 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1279/2522] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:33 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:33.323326 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.334184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65f2b9-71b2-4965-a536-b8f066789d48 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.339981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.340652 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.340934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.341255 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.341987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.343662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.356006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1244/2523] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:33.360278 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.370523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d51a-6492-47e9-a406-7eeb60ba33dd admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.378273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.379250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.379533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.379808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] PATH_INFO: `/v3/projects/e13cbf2c77ac47a09db9e3cef8804dea/users/06bed13d9264455dab029b9f4be58aba/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.400443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13cbf2c77ac47a09db9e3cef8804dea, user_id=06bed13d9264455dab029b9f4be58aba, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.404423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.421497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1280/2524] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:33 2022] PUT /identity/v3/projects/e13cbf2c77ac47a09db9e3cef8804dea/users/06bed13d9264455dab029b9f4be58aba/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:33.425553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.435742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf9c85-1d9d-4e96-8703-d414bdb03de4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.439682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:33.500004 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cee5d0-ec34-4947-a03c-bd1406899c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.500665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cee5d0-ec34-4947-a03c-bd1406899c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.500945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cee5d0-ec34-4947-a03c-bd1406899c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.501213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cee5d0-ec34-4947-a03c-bd1406899c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.501935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cee5d0-ec34-4947-a03c-bd1406899c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.503579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cee5d0-ec34-4947-a03c-bd1406899c41 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.513882 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1245/2525] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:33.518365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.529506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95753f51-4d0f-41ff-86d9-d2bcb30817c7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.535020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.535934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.536218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.536485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] PATH_INFO: `/v3/projects/e13cbf2c77ac47a09db9e3cef8804dea/users/06bed13d9264455dab029b9f4be58aba/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.538905 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13cbf2c77ac47a09db9e3cef8804dea, user_id=06bed13d9264455dab029b9f4be58aba, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.541565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.552379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1281/2526] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:33 2022] PUT /identity/v3/projects/e13cbf2c77ac47a09db9e3cef8804dea/users/06bed13d9264455dab029b9f4be58aba/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:33.562667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.562959 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.563272 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.593286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] MFA Rules not processed for user `06bed13d9264455dab029b9f4be58aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:33.594455 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:33.669418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1246/2527] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:33.681069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.682885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:33.742661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0010e4-f127-4a30-8059-2b5127efe4cb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.746617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.747306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.747586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.747859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.757916 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.759417 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.764430 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:33.769586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1282/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:33.845543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:33.855915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34009d0d-8324-4aac-b04f-2d9a5a30bd33 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:33.860318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82016b56-f455-4ffe-b7ae-8392845916bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:33.860963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016b56-f455-4ffe-b7ae-8392845916bc service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:33.861246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016b56-f455-4ffe-b7ae-8392845916bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:33.861518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82016b56-f455-4ffe-b7ae-8392845916bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:33.921889 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016b56-f455-4ffe-b7ae-8392845916bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:33.923351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82016b56-f455-4ffe-b7ae-8392845916bc service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:33.932642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1247/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:34.181071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:34.182565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:34.255440 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53f2e-4bea-4ab6-a846-51d370d89ca8 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:34.260924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:34.261801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:34.262080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:34.262349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] PATH_INFO: `/v3/users/1a0669a33c1f4d25b923814abe519829` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:34.263633 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0669a33c1f4d25b923814abe519829)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:34.265584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:34.316570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0669a33c1f4d25b923814abe519829'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.324357 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0669a33c1f4d25b923814abe519829'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.325031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0669a33c1f4d25b923814abe519829'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.331886 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0669a33c1f4d25b923814abe519829'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.332494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0669a33c1f4d25b923814abe519829'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.349297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1283/2530] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:34 2022] DELETE /identity/v3/users/1a0669a33c1f4d25b923814abe519829 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:34.354140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:34.354662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:34.354662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:34.373741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:34.375212 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:34.397575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:34.438494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1248/2531] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:34.448460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:34.450118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:34.510697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fdfc6-0972-4671-83d3-408e7d98440d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:34.514773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbf23d-2df7-47ae-8438-b03e3a945ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:34.515460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf23d-2df7-47ae-8438-b03e3a945ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:34.515734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf23d-2df7-47ae-8438-b03e3a945ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:34.516204 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf23d-2df7-47ae-8438-b03e3a945ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:34.525998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbf23d-2df7-47ae-8438-b03e3a945ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:34.527496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbf23d-2df7-47ae-8438-b03e3a945ba1 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:34.537131 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1284/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:34.824045 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:34.825755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:34.837942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5d7c-b5db-44ab-b520-3a2a851b20cd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:34.843672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:34.844540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:34.844818 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:34.845086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] PATH_INFO: `/v3/projects/64bd6358e0f14f3980baf7ab85abb03a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:34.846311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64bd6358e0f14f3980baf7ab85abb03a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:34.848273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:34.900534 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64bd6358e0f14f3980baf7ab85abb03a', 'request_id': 'req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.906233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64bd6358e0f14f3980baf7ab85abb03a', 'request_id': 'req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.917279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64bd6358e0f14f3980baf7ab85abb03a', 'request_id': 'req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.929222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] The token cache is being invalidate because project 64bd6358e0f14f3980baf7ab85abb03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:34.929442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.930087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-edb5e316-b4ad-4d71-9acb-4c8e951a5f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:34.931710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1249/2533] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:34 2022] DELETE /identity/v3/projects/64bd6358e0f14f3980baf7ab85abb03a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:34.936812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:34.937165 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:34.937442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:34.957213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:34.958436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:34.976728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:35.035180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1285/2534] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:35.041871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.042160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.042439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.068404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:35.070226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:35.084557 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1250/2535] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:35.089187 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.099708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bfaf-b8b6-4be6-8b85-bc094d6ff5a1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.105163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.105842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.106123 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.106391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.107163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:35.107462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.109073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.123713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1286/2536] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:35.128125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.137884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41024dc-7448-41d1-b887-c9dcb264cae1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.143071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.143765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.144035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.144486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.145113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.147119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.176740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1251/2537] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:35.181289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.193211 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3a9f-519f-40d4-af56-4ffdbfb43e1a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.256303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.257000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.257279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.257758 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.258505 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.261002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.287029 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1287/2538] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:35.290977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.302501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b420175-1f7d-4abb-880f-def88391ef81 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.307831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.310919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.311239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.311541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.312280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.313896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.326627 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1252/2539] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:35.330869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.346153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea8a71-3783-4ef2-aba3-b25241fbb64c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.346153 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a06f5-260d-4244-887d-a16b3c0aef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.346371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a06f5-260d-4244-887d-a16b3c0aef0f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.346560 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a06f5-260d-4244-887d-a16b3c0aef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.348721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a06f5-260d-4244-887d-a16b3c0aef0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.349531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a06f5-260d-4244-887d-a16b3c0aef0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.351336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a06f5-260d-4244-887d-a16b3c0aef0f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.362635 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1288/2540] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:35.366956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.379133 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b91114-0ad7-41b7-baef-2c12cb5e3d80 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.384196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.385021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.385289 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.385562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] PATH_INFO: `/v3/projects/086e880894344fa1b2cddd9471e1947e/users/aa2211675a8b4dc98b67493c72d71816/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.401181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086e880894344fa1b2cddd9471e1947e, user_id=aa2211675a8b4dc98b67493c72d71816, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.404018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.419887 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1253/2541] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:35 2022] PUT /identity/v3/projects/086e880894344fa1b2cddd9471e1947e/users/aa2211675a8b4dc98b67493c72d71816/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:35.431484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.431707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.431981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.458076 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] MFA Rules not processed for user `aa2211675a8b4dc98b67493c72d71816`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:35.459352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:35.528791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1289/2542] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:35.533538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.589920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:35.607022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6985552-786c-4dc8-8f51-687c16700de0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.611899 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.612569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.612853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.613131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.613845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.615833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.643495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1254/2543] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:35.647891 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.659433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215fc92-7e9d-4582-a316-368b7aea43ce None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.674212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:35.730289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.731261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.731607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.731941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.732981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.735459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.759464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1290/2544] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:35.763531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.774487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521808b-43f8-4a2a-95f1-5394d8bb46c0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.779389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.780065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.780346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.780621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.781366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.782965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.793739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1255/2545] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:35.800475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.812541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9cd71-7566-46d6-ac4e-60a934ca2c3c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.819158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.820058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.820340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.820615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] PATH_INFO: `/v3/projects/34fdf808c520478291e89cad06b3dc81/users/f0af9f4f3f8c4d51bd4b4ec049ce3de5/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.837708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fdf808c520478291e89cad06b3dc81, user_id=f0af9f4f3f8c4d51bd4b4ec049ce3de5, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.840473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.858686 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1291/2546] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:35 2022] PUT /identity/v3/projects/34fdf808c520478291e89cad06b3dc81/users/f0af9f4f3f8c4d51bd4b4ec049ce3de5/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:35.863923 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.874523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ece60-64c0-4aa1-a8fa-28306a8512c8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.933020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0dbbb-16a0-44d1-8758-9af33f9f56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.933697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0dbbb-16a0-44d1-8758-9af33f9f56c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.933980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0dbbb-16a0-44d1-8758-9af33f9f56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.934254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0dbbb-16a0-44d1-8758-9af33f9f56c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.935017 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0dbbb-16a0-44d1-8758-9af33f9f56c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.936651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0dbbb-16a0-44d1-8758-9af33f9f56c0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.946679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1256/2547] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:35.951163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:35.962050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316742dd-1ed5-4adc-8a6a-dc21dc7f6467 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:35.967225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:35.968117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.968387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.968682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] PATH_INFO: `/v3/projects/34fdf808c520478291e89cad06b3dc81/users/f0af9f4f3f8c4d51bd4b4ec049ce3de5/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:35.970674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fdf808c520478291e89cad06b3dc81, user_id=f0af9f4f3f8c4d51bd4b4ec049ce3de5, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:35.973387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:35.984199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1292/2548] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:35 2022] PUT /identity/v3/projects/34fdf808c520478291e89cad06b3dc81/users/f0af9f4f3f8c4d51bd4b4ec049ce3de5/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:35.994502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415d215-0154-4235-9834-98a417b8e21f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:35.994791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415d215-0154-4235-9834-98a417b8e21f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:35.995104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415d215-0154-4235-9834-98a417b8e21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:36.022785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f415d215-0154-4235-9834-98a417b8e21f None None] MFA Rules not processed for user `f0af9f4f3f8c4d51bd4b4ec049ce3de5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:36.024405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f415d215-0154-4235-9834-98a417b8e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:36.099927 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1257/2549] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:36.112518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:36.115401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:36.178361 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31e71c-1ce2-4793-b1d2-6295c884271c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:36.182570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:36.183248 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:36.183530 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:36.183806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:36.193619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:36.195260 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:36.204847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1293/2550] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:36.255687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415d215-0154-4235-9834-98a417b8e21f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:36.257340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f415d215-0154-4235-9834-98a417b8e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:36.269779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415d215-0154-4235-9834-98a417b8e21f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:36.274242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300feb5c-111d-4adf-aa9f-836a2026303a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:36.274920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300feb5c-111d-4adf-aa9f-836a2026303a service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:36.275225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300feb5c-111d-4adf-aa9f-836a2026303a service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:36.275514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300feb5c-111d-4adf-aa9f-836a2026303a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:36.317916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:36.337290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300feb5c-111d-4adf-aa9f-836a2026303a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:36.338744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300feb5c-111d-4adf-aa9f-836a2026303a service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:36.348046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1258/2551] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:36.720020 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:36.721536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:36.792075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e01fd1-148e-48cd-9ce9-6473c2721ba3 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:36.797238 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:36.798121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:36.798401 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:36.798674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] PATH_INFO: `/v3/users/bb700d8e2c0a4e09b0d8edd2f3609df9` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:36.799928 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb700d8e2c0a4e09b0d8edd2f3609df9)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:36.801872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:36.815974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:36.853515 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb700d8e2c0a4e09b0d8edd2f3609df9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:36.864145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb700d8e2c0a4e09b0d8edd2f3609df9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:36.864831 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb700d8e2c0a4e09b0d8edd2f3609df9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:36.872640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb700d8e2c0a4e09b0d8edd2f3609df9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:36.873321 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb700d8e2c0a4e09b0d8edd2f3609df9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:36.893182 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1294/2552] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:36 2022] DELETE /identity/v3/users/bb700d8e2c0a4e09b0d8edd2f3609df9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:36.897905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:36.898739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:36.898834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:36.917239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:36.918580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:36.988241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1259/2553] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:36.998028 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:36.999558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:37.056906 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba615b-8fef-440b-ab3b-b6c67a4daabe admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:37.061072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:37.061718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:37.061998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:37.062265 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:37.071875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:37.073307 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:37.082862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1295/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:37.371837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:37.373389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:37.388535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce25d4-2ead-4b35-8d57-c4e9ee9ae605 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:37.393222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:37.394119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:37.394404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:37.394679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] PATH_INFO: `/v3/projects/4f5d8195cacf4d149eee49367e23c7ff` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:37.396411 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5d8195cacf4d149eee49367e23c7ff)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:37.398945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:37.463409 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5d8195cacf4d149eee49367e23c7ff', 'request_id': 'req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.469630 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5d8195cacf4d149eee49367e23c7ff', 'request_id': 'req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.479197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5d8195cacf4d149eee49367e23c7ff', 'request_id': 'req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.493538 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] The token cache is being invalidate because project 4f5d8195cacf4d149eee49367e23c7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:37.493829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.494511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.496195 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1260/2555] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:37 2022] DELETE /identity/v3/projects/4f5d8195cacf4d149eee49367e23c7ff => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:37.500258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:37.510539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0cc4-8075-480b-bc94-195e832fb9f4 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:37.570073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:37.571066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:37.571346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:37.571622 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] PATH_INFO: `/v3/users/06bed13d9264455dab029b9f4be58aba` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:37.572834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06bed13d9264455dab029b9f4be58aba)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:37.574807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:37.614590 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:37.624492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06bed13d9264455dab029b9f4be58aba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.632682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06bed13d9264455dab029b9f4be58aba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.633790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06bed13d9264455dab029b9f4be58aba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.644009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06bed13d9264455dab029b9f4be58aba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.644821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ebd90293-0660-424f-acde-2fe0792c6aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06bed13d9264455dab029b9f4be58aba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:37.661961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1296/2556] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:37 2022] DELETE /identity/v3/users/06bed13d9264455dab029b9f4be58aba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:37.956319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:37.958039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:37.987955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfa8d4-e12b-4736-99c0-6009e816c0fc admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.049131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.050172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.050372 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.050710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] PATH_INFO: `/v3/projects/e13cbf2c77ac47a09db9e3cef8804dea` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.051854 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13cbf2c77ac47a09db9e3cef8804dea)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.053812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.061265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:38.112733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13cbf2c77ac47a09db9e3cef8804dea', 'request_id': 'req-83627ed6-c3d4-4d7b-80dc-2cdc96719379'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:38.120220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13cbf2c77ac47a09db9e3cef8804dea', 'request_id': 'req-83627ed6-c3d4-4d7b-80dc-2cdc96719379'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:38.134946 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13cbf2c77ac47a09db9e3cef8804dea', 'request_id': 'req-83627ed6-c3d4-4d7b-80dc-2cdc96719379'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:38.146982 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] The token cache is being invalidate because project e13cbf2c77ac47a09db9e3cef8804dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:38.147300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:38.147981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-83627ed6-c3d4-4d7b-80dc-2cdc96719379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:38.150038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1261/2557] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:37 2022] DELETE /identity/v3/projects/e13cbf2c77ac47a09db9e3cef8804dea => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:38.155107 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.155548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.155744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.173961 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:38.175356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:38.235990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1297/2558] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:38.245312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.245601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.245880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.264852 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:38.266054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:38.275478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1262/2559] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:38.280077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.290661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61296e31-2aba-454e-a13b-f4992c4d0c51 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.296506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.296959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.297209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.297738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.298603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:38.298806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.300822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.313324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1298/2560] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:38.318021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.327824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc121e7e-6431-4783-8d55-9de02b13a146 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.332758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.333422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.333707 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.333984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.334694 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.336861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.366626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1263/2561] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:38.372397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.383746 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4139d-2be4-496a-8094-f961963eaa94 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.441527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.442195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.442473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.442744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.443490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.445416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.467230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1299/2562] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:38.472152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.484559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa29747-c2c3-4087-9b6f-622b67dcb340 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.489381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.490044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.490325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.490597 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.491357 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.492953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.503440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1264/2563] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:38.507543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.517871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172191d-7d5d-4255-ab27-93057d13a1cc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.522584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eb587-8845-410e-9fa3-11f5adc43363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.523618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb587-8845-410e-9fa3-11f5adc43363 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.523893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb587-8845-410e-9fa3-11f5adc43363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.524161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb587-8845-410e-9fa3-11f5adc43363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.524885 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eb587-8845-410e-9fa3-11f5adc43363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.526477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eb587-8845-410e-9fa3-11f5adc43363 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.536887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1300/2564] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:38.541193 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.551851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ec8d-d649-4217-8763-36a0c039e09b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.558182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.559129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.559408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.559678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] PATH_INFO: `/v3/projects/2d857673859543f7bb9b25446b859f88/users/b930fa9bce4b4a8d8fcb45f960064b1d/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.575087 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d857673859543f7bb9b25446b859f88, user_id=b930fa9bce4b4a8d8fcb45f960064b1d, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.577758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.593588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1265/2565] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:38 2022] PUT /identity/v3/projects/2d857673859543f7bb9b25446b859f88/users/b930fa9bce4b4a8d8fcb45f960064b1d/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:38.604354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.604639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.604963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.633049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] MFA Rules not processed for user `b930fa9bce4b4a8d8fcb45f960064b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:38.634391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:38.643388 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:38.708624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1301/2566] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:38.713465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.776471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fed8b-fce9-4bc1-ad29-e71b1dd51d6b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.782750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.783448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.783733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.784006 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.784728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.786821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.815279 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1266/2567] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:38.819569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.830721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733c1c-9358-4581-ab08-9990b4aa5e3c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.895577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.896242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.896527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.896801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.897514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.899937 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.922125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1302/2568] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:38 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:38.926301 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.937268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c342-05b1-4a3a-a6bc-74ff96693da8 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.943190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.943863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.944281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.944569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:38.945300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:38.947320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:38.964778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1267/2569] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:38.970970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:38.986428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cda57-82ef-43ae-8282-fcd7fee0b885 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:38.995025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:38.995940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:38.996220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:38.996489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] PATH_INFO: `/v3/projects/ff1857c7fc524aa2b4efe82b48062585/users/ae45510eec5946a7913af099796ba408/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.012462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1857c7fc524aa2b4efe82b48062585, user_id=ae45510eec5946a7913af099796ba408, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:39.015158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:39.029747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1303/2570] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:38 2022] PUT /identity/v3/projects/ff1857c7fc524aa2b4efe82b48062585/users/ae45510eec5946a7913af099796ba408/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:39.033761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:39.040156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:39.044735 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82008817-9e41-41b7-a836-e5b365928019 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:39.104781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9f24d-42e0-4c0b-9b7e-b659a596e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:39.105366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f24d-42e0-4c0b-9b7e-b659a596e55b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:39.105624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f24d-42e0-4c0b-9b7e-b659a596e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:39.105888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f24d-42e0-4c0b-9b7e-b659a596e55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.106616 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f24d-42e0-4c0b-9b7e-b659a596e55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:39.108253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f24d-42e0-4c0b-9b7e-b659a596e55b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:39.123472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1268/2571] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:39.129989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:39.143558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfe157-3baa-43ef-99c6-7f5598087cf5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:39.149443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:39.150537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:39.150821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:39.151149 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] PATH_INFO: `/v3/projects/ff1857c7fc524aa2b4efe82b48062585/users/ae45510eec5946a7913af099796ba408/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.153218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1857c7fc524aa2b4efe82b48062585, user_id=ae45510eec5946a7913af099796ba408, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:39.155983 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:39.168026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1304/2572] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:39 2022] PUT /identity/v3/projects/ff1857c7fc524aa2b4efe82b48062585/users/ae45510eec5946a7913af099796ba408/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:39.178446 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:39.178727 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:39.179020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.207471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] MFA Rules not processed for user `ae45510eec5946a7913af099796ba408`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:39.208700 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:39.300561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1269/2573] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:39.308837 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:39.310554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:39.371965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f924c26-75b8-482f-8e54-6eafafaf10d8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:39.376015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd4aa0-cfd9-4411-b68c-cf942cdd3505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:39.376911 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4aa0-cfd9-4411-b68c-cf942cdd3505 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:39.377201 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4aa0-cfd9-4411-b68c-cf942cdd3505 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:39.377484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd4aa0-cfd9-4411-b68c-cf942cdd3505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.392104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:39.441345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4aa0-cfd9-4411-b68c-cf942cdd3505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:39.442802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd4aa0-cfd9-4411-b68c-cf942cdd3505 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:39.451910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1305/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:39.733975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:39.735778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:39.805041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e87e0-43cc-4a21-bbfe-49111c8adb1e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:39.809579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:39.810462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:39.810744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:39.811038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] PATH_INFO: `/v3/users/aa2211675a8b4dc98b67493c72d71816` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.812228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2211675a8b4dc98b67493c72d71816)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:39.814160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:39.850131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:39.873097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2211675a8b4dc98b67493c72d71816'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:39.882141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2211675a8b4dc98b67493c72d71816'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:39.882820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2211675a8b4dc98b67493c72d71816'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:39.889942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2211675a8b4dc98b67493c72d71816'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:39.902271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2211675a8b4dc98b67493c72d71816'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:39.908859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1270/2575] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:39 2022] DELETE /identity/v3/users/aa2211675a8b4dc98b67493c72d71816 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:39.913601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:39.913890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:39.914160 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:39.933390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:39.934612 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:40.014787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1306/2576] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:40.026359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:40.027903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:40.096101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195532-b031-46cc-8de3-05dce38b5224 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:40.099963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:40.100612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:40.100896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:40.101167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:40.115027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:40.117371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:40.128294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1271/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:40.413752 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:40.415273 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:40.428585 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5eb3-6675-4a2f-85ab-f93a037a79c6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:40.433742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:40.434675 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:40.434981 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:40.435283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] PATH_INFO: `/v3/projects/086e880894344fa1b2cddd9471e1947e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:40.436518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086e880894344fa1b2cddd9471e1947e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:40.438450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:40.489596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086e880894344fa1b2cddd9471e1947e', 'request_id': 'req-9510981e-ed41-44b4-8b41-7b89f1b10559'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.497259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086e880894344fa1b2cddd9471e1947e', 'request_id': 'req-9510981e-ed41-44b4-8b41-7b89f1b10559'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.503189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086e880894344fa1b2cddd9471e1947e', 'request_id': 'req-9510981e-ed41-44b4-8b41-7b89f1b10559'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.514564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] The token cache is being invalidate because project 086e880894344fa1b2cddd9471e1947e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:40.514854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.515550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.517116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1307/2578] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:40 2022] DELETE /identity/v3/projects/086e880894344fa1b2cddd9471e1947e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:40.521484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:40.531775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1de3b4-e607-4f9e-89aa-38e748d857f5 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:40.589201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:40.590082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:40.590362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:40.590661 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] PATH_INFO: `/v3/users/f0af9f4f3f8c4d51bd4b4ec049ce3de5` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:40.591893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0af9f4f3f8c4d51bd4b4ec049ce3de5)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:40.593817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:40.654829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0af9f4f3f8c4d51bd4b4ec049ce3de5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.658259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:40.665832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0af9f4f3f8c4d51bd4b4ec049ce3de5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.666541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0af9f4f3f8c4d51bd4b4ec049ce3de5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.674344 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0af9f4f3f8c4d51bd4b4ec049ce3de5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.690452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0af9f4f3f8c4d51bd4b4ec049ce3de5'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:40.697383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1272/2579] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:40 2022] DELETE /identity/v3/users/f0af9f4f3f8c4d51bd4b4ec049ce3de5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:40.820958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:40.822572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:40.870462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:40.889466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510981e-ed41-44b4-8b41-7b89f1b10559 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:40.944786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:40.945431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:40.945825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:40.946378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:40.948821 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:40.989210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:40.991062 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:41.021537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.023038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95503e7b-326e-4188-acc0-bf10966b8b19 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.033246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1308/2580] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:41.061103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b55d-f70c-4d42-b5ea-8c255087c5ae admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.067100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.068000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.068278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.068558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] PATH_INFO: `/v3/projects/34fdf808c520478291e89cad06b3dc81` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.069759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fdf808c520478291e89cad06b3dc81)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.075793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.127866 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fdf808c520478291e89cad06b3dc81', 'request_id': 'req-24f8e362-4954-4e0b-b52c-eaee08878e1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:41.134224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fdf808c520478291e89cad06b3dc81', 'request_id': 'req-24f8e362-4954-4e0b-b52c-eaee08878e1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:41.143047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fdf808c520478291e89cad06b3dc81', 'request_id': 'req-24f8e362-4954-4e0b-b52c-eaee08878e1e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:41.155302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] The token cache is being invalidate because project 34fdf808c520478291e89cad06b3dc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:41.155621 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:41.156233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-24f8e362-4954-4e0b-b52c-eaee08878e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:41.157834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1273/2581] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:40 2022] DELETE /identity/v3/projects/34fdf808c520478291e89cad06b3dc81 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:41.163195 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.164019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.164421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.187670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:41.188931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:41.249926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1309/2582] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:41.258308 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.258587 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.258867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.278956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:41.280233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:41.289089 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1274/2583] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:41.293651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.304625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59cf3b-e49e-4cf5-bb7c-5884f615c326 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.310117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.310779 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.311059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.311341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.312061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:41.312364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.313975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.326110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1310/2584] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:41.330753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.341100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c6048-401f-4bb7-b56e-20b00867e056 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.346969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.347676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.347954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.348231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.348947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.350885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.379345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1275/2585] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:41.383926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.394167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9628d-ee09-446e-8bc2-a743959532e6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.424572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:41.453301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.454186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.454332 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.454487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.455222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.457142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.479586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1311/2586] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:41.483851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.494748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ceab51-023b-4e3a-a4c4-711a05d06122 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.500051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.500711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.500989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.501295 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.502073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.503689 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.515720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1276/2587] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:41.520008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.530715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437ac9a-b85a-46af-a9b9-8f2cf59bd433 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.535554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860951c3-f610-45b7-b3ee-c27b87f9c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.536212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860951c3-f610-45b7-b3ee-c27b87f9c34d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.536493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860951c3-f610-45b7-b3ee-c27b87f9c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.536764 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860951c3-f610-45b7-b3ee-c27b87f9c34d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.537486 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860951c3-f610-45b7-b3ee-c27b87f9c34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.539119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860951c3-f610-45b7-b3ee-c27b87f9c34d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.551134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1312/2588] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:41.555463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.565893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88883-b90e-4a2d-b09a-7f015621e729 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.570650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.571563 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.571833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.572096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] PATH_INFO: `/v3/projects/f825fd77776d47a5bef9ad82cb731842/users/e50c8d3f54864e13b19df18ff1702567/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.588137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f825fd77776d47a5bef9ad82cb731842, user_id=e50c8d3f54864e13b19df18ff1702567, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.590853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.593136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:41.610722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1277/2589] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:41 2022] PUT /identity/v3/projects/f825fd77776d47a5bef9ad82cb731842/users/e50c8d3f54864e13b19df18ff1702567/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:41.622497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.622786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.623093 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.651713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] MFA Rules not processed for user `e50c8d3f54864e13b19df18ff1702567`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:41.653069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:41.725484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1313/2590] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:41.732038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.806027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c18a-9b96-4f1d-bb69-46b127402a4c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.811645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.812300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.812575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.812846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.813512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.815491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.845118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1278/2591] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:41.849554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.860691 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e04a66-75fe-48d0-9e5d-77d8f3096fb2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.919801 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.920478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.920765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.921039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.921738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.925478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.951021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1314/2592] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:41 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:41.955766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:41.971432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f85e3-b175-469f-9b1c-1526dcf9eca9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:41.979112 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:41.979920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:41.980335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:41.980610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:41.981360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:41.983014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:41.993784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1279/2593] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:41.998161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:42.008286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72752-bf4d-4dc8-8026-232180352087 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:42.013121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:42.014004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:42.014279 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:42.014550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] PATH_INFO: `/v3/projects/14dd805d24434daeb55915206d4eb76c/users/967b9e118e6a4348bb2544bc1fb9d227/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:42.029754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14dd805d24434daeb55915206d4eb76c, user_id=967b9e118e6a4348bb2544bc1fb9d227, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:42.032723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:42.047703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1315/2594] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:41 2022] PUT /identity/v3/projects/14dd805d24434daeb55915206d4eb76c/users/967b9e118e6a4348bb2544bc1fb9d227/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:42.051884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:42.062375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78feb15-7dee-46d2-94ea-c929d06904e0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:42.120169 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e6dc4-9d2e-477b-b023-3fb30c9e42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:42.120842 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e6dc4-9d2e-477b-b023-3fb30c9e42aa admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:42.121121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e6dc4-9d2e-477b-b023-3fb30c9e42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:42.121387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e6dc4-9d2e-477b-b023-3fb30c9e42aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:42.122171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e6dc4-9d2e-477b-b023-3fb30c9e42aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:42.123847 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e6dc4-9d2e-477b-b023-3fb30c9e42aa admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:42.137977 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1280/2595] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:42.142298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:42.153297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017764fe-4152-46b9-819f-d7daf5ce47a2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:42.158232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:42.159159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:42.159433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:42.159706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] PATH_INFO: `/v3/projects/14dd805d24434daeb55915206d4eb76c/users/967b9e118e6a4348bb2544bc1fb9d227/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:42.161744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14dd805d24434daeb55915206d4eb76c, user_id=967b9e118e6a4348bb2544bc1fb9d227, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:42.164441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:42.166688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:42.178614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1316/2596] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:42 2022] PUT /identity/v3/projects/14dd805d24434daeb55915206d4eb76c/users/967b9e118e6a4348bb2544bc1fb9d227/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:42.189347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:42.189635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:42.190302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:42.217631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] MFA Rules not processed for user `967b9e118e6a4348bb2544bc1fb9d227`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:42.218823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:42.274501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:42.309894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1281/2597] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:42.320872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:42.323285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:42.389667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d4fe-b972-413b-9523-fec5766046a0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:42.393544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:42.394192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:42.394482 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:42.394735 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:42.404813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:42.406271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:42.417143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1317/2598] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:42.468631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:42.479365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5d3d5-5eb4-43ec-b6d6-ae653b5064d7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:42.483078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d9db5-4407-4979-863e-bf58ff36ef5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:42.483730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d9db5-4407-4979-863e-bf58ff36ef5b service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:42.484068 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d9db5-4407-4979-863e-bf58ff36ef5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:42.484269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d9db5-4407-4979-863e-bf58ff36ef5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:42.545969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d9db5-4407-4979-863e-bf58ff36ef5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:42.547454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d9db5-4407-4979-863e-bf58ff36ef5b service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:42.556519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1282/2599] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:44.815436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:44.817039 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:44.884404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d07f1-f52a-414c-a663-c06bda197892 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:44.889549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:44.890436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:44.890717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:44.890997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] PATH_INFO: `/v3/users/b930fa9bce4b4a8d8fcb45f960064b1d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:44.892328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b930fa9bce4b4a8d8fcb45f960064b1d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:44.894228 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:44.942786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b930fa9bce4b4a8d8fcb45f960064b1d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:44.953497 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b930fa9bce4b4a8d8fcb45f960064b1d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:44.954112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b930fa9bce4b4a8d8fcb45f960064b1d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:44.961404 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b930fa9bce4b4a8d8fcb45f960064b1d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:44.962071 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b930fa9bce4b4a8d8fcb45f960064b1d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:44.982213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1318/2600] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:44 2022] DELETE /identity/v3/users/b930fa9bce4b4a8d8fcb45f960064b1d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:44.987650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:44.988178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:44.988274 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:45.007298 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:45.008496 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:45.068506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1283/2601] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:45.080367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:45.082634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:45.111023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:45.167842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbfc05-5f00-433d-8f76-14ef751a8d6f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:45.172857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:45.173529 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:45.173805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:45.174075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:45.183884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:45.185324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:45.194807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1319/2602] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:45.467894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:45.469471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:45.481728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc455dd-2bc2-4989-8183-f3b1a1fcf4aa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:45.486906 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:45.487856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:45.488122 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:45.488488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] PATH_INFO: `/v3/projects/2d857673859543f7bb9b25446b859f88` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:45.489754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d857673859543f7bb9b25446b859f88)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:45.491773 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:45.542143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d857673859543f7bb9b25446b859f88', 'request_id': 'req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.548479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d857673859543f7bb9b25446b859f88', 'request_id': 'req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.557389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d857673859543f7bb9b25446b859f88', 'request_id': 'req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.568718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] The token cache is being invalidate because project 2d857673859543f7bb9b25446b859f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:45.569026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.569686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.571302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1284/2603] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:45 2022] DELETE /identity/v3/projects/2d857673859543f7bb9b25446b859f88 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:45.575451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:45.585370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff373a-b374-4ff9-8e8c-73a08b44a681 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:45.644570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:45.645460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:45.645736 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:45.646004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] PATH_INFO: `/v3/users/ae45510eec5946a7913af099796ba408` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:45.647270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae45510eec5946a7913af099796ba408)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:45.649578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:45.707800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae45510eec5946a7913af099796ba408'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.717064 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae45510eec5946a7913af099796ba408'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.717710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae45510eec5946a7913af099796ba408'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.724761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae45510eec5946a7913af099796ba408'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.725413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae45510eec5946a7913af099796ba408'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:45.742765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1320/2604] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:45 2022] DELETE /identity/v3/users/ae45510eec5946a7913af099796ba408 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:45.921379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:45.922821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:45.936047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517e05-507d-4e9c-9fbd-0d03c9f82bf2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:45.944811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:45.997057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:45.998018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:45.998294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:45.998570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] PATH_INFO: `/v3/users/e50c8d3f54864e13b19df18ff1702567` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:45.999828 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50c8d3f54864e13b19df18ff1702567)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.001747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.028026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.030437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.045481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066954f-1d4b-4676-b898-83e0e8885327 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.052425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.053618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.053972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.054220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] PATH_INFO: `/v3/projects/ff1857c7fc524aa2b4efe82b48062585` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.055619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1857c7fc524aa2b4efe82b48062585)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.057503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.068734 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50c8d3f54864e13b19df18ff1702567'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.077794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50c8d3f54864e13b19df18ff1702567'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.078510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50c8d3f54864e13b19df18ff1702567'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.086418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50c8d3f54864e13b19df18ff1702567'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.094957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:46.099884 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-13737321-4cb3-4918-b18b-8ea23058f049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50c8d3f54864e13b19df18ff1702567'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.106306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1285/2605] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:45 2022] DELETE /identity/v3/users/e50c8d3f54864e13b19df18ff1702567 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:46.111344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1857c7fc524aa2b4efe82b48062585', 'request_id': 'req-be831ce5-442e-431a-864c-23e0ba35df74'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.111472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.111768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.112072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.119562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1857c7fc524aa2b4efe82b48062585', 'request_id': 'req-be831ce5-442e-431a-864c-23e0ba35df74'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.125451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1857c7fc524aa2b4efe82b48062585', 'request_id': 'req-be831ce5-442e-431a-864c-23e0ba35df74'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.130312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:46.131553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.136992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] The token cache is being invalidate because project ff1857c7fc524aa2b4efe82b48062585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:46.137281 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.137922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-be831ce5-442e-431a-864c-23e0ba35df74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.139587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1321/2606] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:46 2022] DELETE /identity/v3/projects/ff1857c7fc524aa2b4efe82b48062585 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:46.144322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f045ad-a7a7-4216-bd4e-ad1dc64893bf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.144636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f045ad-a7a7-4216-bd4e-ad1dc64893bf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.144912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f045ad-a7a7-4216-bd4e-ad1dc64893bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.163315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d9f045ad-a7a7-4216-bd4e-ad1dc64893bf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:46.164555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d9f045ad-a7a7-4216-bd4e-ad1dc64893bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.194097 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1286/2607] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:46.204200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.205565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.224945 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1322/2608] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:46.233820 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.234305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.234594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.243027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:46.253395 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:46.254712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.263154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1323/2609] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:46.267946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.270153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7d53d-8be1-45a2-b139-0b5b17b75ce2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.276801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.277430 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.277708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.277981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.280755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1383-6381-4ce4-828e-f41e97ba4fba None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.285227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.285868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.286142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.286410 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.287284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:46.287627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.287770 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.289181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.289302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.298834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1287/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:46.302110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1324/2611] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:48:46.306809 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.319507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df40290-3b7a-41d5-9d3a-15db973f54ec service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.325096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.325755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.326063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.326335 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.327063 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.328997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.357860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1288/2612] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:46.362223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.372586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fea20c-7a7b-4d4c-8bd0-3217906191e4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.438663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.439382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.439665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.439942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.440669 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.442638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.466363 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1325/2613] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:46.470662 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.481031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ecdf-9ab1-4944-a82d-08da389c20d1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.486052 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.486737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.487048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.487324 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.488154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.489965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.501366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1289/2614] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:46.505542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.516208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84f13-5b09-471e-99f4-83e8f64aef2d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.521090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.521845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.522184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.522550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.523740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.525518 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.536394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1326/2615] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:46.540697 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.551659 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c905c-faa0-4bc8-8351-bc4fcc90d801 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.556572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653dbb2-921a-4f8b-9cd9-762a3693f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.557462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653dbb2-921a-4f8b-9cd9-762a3693f159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.557742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653dbb2-921a-4f8b-9cd9-762a3693f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.558012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653dbb2-921a-4f8b-9cd9-762a3693f159 admin admin] PATH_INFO: `/v3/projects/7bb60b0c62e54b8a9d0a129c9769d9ff/users/41364057dfac468f9ec2fa4fcfb4f1f8/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.574607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653dbb2-921a-4f8b-9cd9-762a3693f159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb60b0c62e54b8a9d0a129c9769d9ff, user_id=41364057dfac468f9ec2fa4fcfb4f1f8, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.578046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653dbb2-921a-4f8b-9cd9-762a3693f159 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.584185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.586291 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.597421 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1290/2616] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:46 2022] PUT /identity/v3/projects/7bb60b0c62e54b8a9d0a129c9769d9ff/users/41364057dfac468f9ec2fa4fcfb4f1f8/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:46.600405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef829c7c-39be-46d5-b3d7-831b1c8a25a3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.607598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.607888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.608160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.620899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:46.636070 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] MFA Rules not processed for user `41364057dfac468f9ec2fa4fcfb4f1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:46.637315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.670372 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.671316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.671728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.672007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] PATH_INFO: `/v3/projects/f825fd77776d47a5bef9ad82cb731842` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.673218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f825fd77776d47a5bef9ad82cb731842)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.675181 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.710224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1291/2617] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:46.715687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.726454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780808c-d18f-49e3-b6fe-eb87162be189 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.727197 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f825fd77776d47a5bef9ad82cb731842', 'request_id': 'req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.737284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f825fd77776d47a5bef9ad82cb731842', 'request_id': 'req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.743331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f825fd77776d47a5bef9ad82cb731842', 'request_id': 'req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.755882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] The token cache is being invalidate because project f825fd77776d47a5bef9ad82cb731842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:46.756176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.756860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.758472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1327/2618] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:46 2022] DELETE /identity/v3/projects/f825fd77776d47a5bef9ad82cb731842 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:46.762524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.764152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.786374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.787090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.787360 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.787633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.788354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.790443 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.800580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:46.817856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1292/2619] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:46.821986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.823626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.833356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e15f53-e95f-4e3c-bdf9-c22bc76e921a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.884455 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:46.889678 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d549e2-88d5-42cd-a739-b57931c090a9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.892229 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.893172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.893537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.894023 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] PATH_INFO: `/v3/users/967b9e118e6a4348bb2544bc1fb9d227` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.895243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.895838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=967b9e118e6a4348bb2544bc1fb9d227)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.895970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.896396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.896713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.897407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.897915 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.899720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.920963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1293/2620] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:46 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:46.924742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.934552 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58224-58d1-4854-810f-d0c753cbef27 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.939582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.940541 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.940840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.941104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.941833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:46.943525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:46.947543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967b9e118e6a4348bb2544bc1fb9d227'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.954025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1294/2621] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:46.955812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967b9e118e6a4348bb2544bc1fb9d227'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.956520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967b9e118e6a4348bb2544bc1fb9d227'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.958962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:46.960701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:46.963608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967b9e118e6a4348bb2544bc1fb9d227'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.964245 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967b9e118e6a4348bb2544bc1fb9d227'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:46.973241 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf7cf-11ae-4b35-9ec3-f9b28acfc589 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:46.978077 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64634670-507d-44df-af80-c73695aa551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:46.978960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64634670-507d-44df-af80-c73695aa551a admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:46.979276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64634670-507d-44df-af80-c73695aa551a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:46.979567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64634670-507d-44df-af80-c73695aa551a admin admin] PATH_INFO: `/v3/projects/25cd7267b6264f44a60a8cee201f83b1/users/874ac8e7ed4241f0a89988e9036bdf87/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:46.982082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1328/2622] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:46 2022] DELETE /identity/v3/users/967b9e118e6a4348bb2544bc1fb9d227 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:46.998745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64634670-507d-44df-af80-c73695aa551a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cd7267b6264f44a60a8cee201f83b1, user_id=874ac8e7ed4241f0a89988e9036bdf87, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.001424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64634670-507d-44df-af80-c73695aa551a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.016573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1295/2623] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:46 2022] PUT /identity/v3/projects/25cd7267b6264f44a60a8cee201f83b1/users/874ac8e7ed4241f0a89988e9036bdf87/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:47.021000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.087889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdc3c5-beb9-4978-a6cb-6d6e14fcea0f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.145634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ab57-9e04-4031-b36a-681733e101ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.146352 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ab57-9e04-4031-b36a-681733e101ae admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.146631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ab57-9e04-4031-b36a-681733e101ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.146868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ab57-9e04-4031-b36a-681733e101ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.147670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26ab57-9e04-4031-b36a-681733e101ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.149625 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26ab57-9e04-4031-b36a-681733e101ae admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.160399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1329/2624] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:47.164824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64634670-507d-44df-af80-c73695aa551a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.175485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64634670-507d-44df-af80-c73695aa551a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.180377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.181243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.181526 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.181805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] PATH_INFO: `/v3/projects/25cd7267b6264f44a60a8cee201f83b1/users/874ac8e7ed4241f0a89988e9036bdf87/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.183999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cd7267b6264f44a60a8cee201f83b1, user_id=874ac8e7ed4241f0a89988e9036bdf87, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.186704 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.202010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1296/2625] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:47 2022] PUT /identity/v3/projects/25cd7267b6264f44a60a8cee201f83b1/users/874ac8e7ed4241f0a89988e9036bdf87/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:47.213719 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.214008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.214285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.242381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] MFA Rules not processed for user `874ac8e7ed4241f0a89988e9036bdf87`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:47.243631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.252858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:47.261008 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.263168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.328316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1330/2626] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:47.340774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.342209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.352234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e443d-e2dd-403e-b3b3-8264b5d0c19c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.356931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.357908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.358186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.358462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] PATH_INFO: `/v3/projects/14dd805d24434daeb55915206d4eb76c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.359665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14dd805d24434daeb55915206d4eb76c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.361610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.403648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:47.405759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aab8e7-4acf-456d-99ca-5dfb53f8f31c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.415722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14dd805d24434daeb55915206d4eb76c', 'request_id': 'req-cdd70ad4-7623-430d-b055-3186ee1d7ec2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.421192 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14dd805d24434daeb55915206d4eb76c', 'request_id': 'req-cdd70ad4-7623-430d-b055-3186ee1d7ec2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.429450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14dd805d24434daeb55915206d4eb76c', 'request_id': 'req-cdd70ad4-7623-430d-b055-3186ee1d7ec2'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.441666 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] The token cache is being invalidate because project 14dd805d24434daeb55915206d4eb76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:47.442118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.442602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-cdd70ad4-7623-430d-b055-3186ee1d7ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.444242 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1297/2627] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:47 2022] DELETE /identity/v3/projects/14dd805d24434daeb55915206d4eb76c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:47.448944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b664d7-28c5-48ca-bc78-32b3bec8630a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.449231 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b664d7-28c5-48ca-bc78-32b3bec8630a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.449511 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b664d7-28c5-48ca-bc78-32b3bec8630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.460241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.460907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.461189 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.461465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.463713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.467999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f0b664d7-28c5-48ca-bc78-32b3bec8630a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:47.469173 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f0b664d7-28c5-48ca-bc78-32b3bec8630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.527646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.528960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1298/2628] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:47.529081 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.537947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.538260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.538756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.541895 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1331/2629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:47.557364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:47.559043 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.566956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1299/2630] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:47.571114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.583249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35ff2-9a99-409a-8996-1f93b5b6d1c7 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.588490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.591219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.591554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.591936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.592712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:47.592999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.594603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.601745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:47.611395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.613019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.614077 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1332/2631] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:47.614971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.625311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad92f-1266-49b2-8d64-f42f96236c98 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.625644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc6d4-5768-41e4-950a-691a19895fb7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.631069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.631237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.631998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.632275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.632424 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.632512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.632591 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] PATH_INFO: `/v3/users/41364057dfac468f9ec2fa4fcfb4f1f8` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.632780 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.633517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.633976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41364057dfac468f9ec2fa4fcfb4f1f8)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.635544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.635954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.665439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1333/2632] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:47.669789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.686562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41364057dfac468f9ec2fa4fcfb4f1f8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.695808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41364057dfac468f9ec2fa4fcfb4f1f8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.696554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41364057dfac468f9ec2fa4fcfb4f1f8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.705418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41364057dfac468f9ec2fa4fcfb4f1f8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.719177 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-fb0625dd-b7aa-4520-b1cf-45741a2e0f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41364057dfac468f9ec2fa4fcfb4f1f8'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:47.725954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1300/2633] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:47 2022] DELETE /identity/v3/users/41364057dfac468f9ec2fa4fcfb4f1f8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:47.730729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.731051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.731336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.737957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a258df-cfa5-440d-8186-1367174f594d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.749294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:47.750518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.776339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:47.804893 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.805679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.805968 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.806287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.807002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.809193 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.815963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1301/2634] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:47.827300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.828719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.830936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1334/2635] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:47.835127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.837089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:47.849472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ec27a-58d2-41db-8c78-49bb04b3eed3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.854188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.854867 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.855192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.855464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.856214 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.857816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.868009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1335/2636] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:47.872274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.882628 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd136b7-a35a-49fe-ac44-63138d74540c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.885300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e746-4eb6-4bfb-8f34-c8f16065ffaa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.887362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.888014 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.888294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.888652 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.889042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd97a45-edf0-4189-a43d-6fb38323f315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.889390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.889719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97a45-edf0-4189-a43d-6fb38323f315 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.889992 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97a45-edf0-4189-a43d-6fb38323f315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.890259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97a45-edf0-4189-a43d-6fb38323f315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.891050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.899619 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97a45-edf0-4189-a43d-6fb38323f315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.901048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97a45-edf0-4189-a43d-6fb38323f315 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.901868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1336/2637] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:47.906001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:47.911720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1302/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:47.916293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9630aa-3b04-4ab7-ac39-57960911ebec admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:47.922912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:47.923860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.924139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.924411 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] PATH_INFO: `/v3/projects/898a8b94af844e0b974a95484c58540f/users/96a143dbe0c74dd98cd56683efe906b5/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.939190 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898a8b94af844e0b974a95484c58540f, user_id=96a143dbe0c74dd98cd56683efe906b5, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:47.941912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:47.955756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1337/2639] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:47 2022] PUT /identity/v3/projects/898a8b94af844e0b974a95484c58540f/users/96a143dbe0c74dd98cd56683efe906b5/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:47.966580 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:47.966886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:47.967178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:47.994705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] MFA Rules not processed for user `96a143dbe0c74dd98cd56683efe906b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:47.996010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.067117 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1303/2640] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:48.071017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.108063 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:48.144856 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565268-306b-4a10-b21d-ac7ac73975f3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.150385 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.151092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.151373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.151646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.152337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.154258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.185245 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1338/2641] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:48 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:48.186713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.199570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba8c88-210d-4ebf-a144-70fd2c2b3ab6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.208603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.210685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.264431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.265273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.265544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.265834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.266530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.268493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.277626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:48.280330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5099aa-add5-4fa5-9067-88dd89894f38 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.285859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.286984 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.287286 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.287568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] PATH_INFO: `/v3/projects/7bb60b0c62e54b8a9d0a129c9769d9ff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.288769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb60b0c62e54b8a9d0a129c9769d9ff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.290710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.291682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1304/2642] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:48 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:48.295490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.305833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039b7e-11e8-475a-9c9e-e41269d660b4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.310611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.311258 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.311536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.311808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.312529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.314143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.327561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1305/2643] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:48.328997 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.338797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44e0e-1d54-4970-8ca5-d8e9f824028e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.344509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb60b0c62e54b8a9d0a129c9769d9ff', 'request_id': 'req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.353509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb60b0c62e54b8a9d0a129c9769d9ff', 'request_id': 'req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.360097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb60b0c62e54b8a9d0a129c9769d9ff', 'request_id': 'req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.377254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] The token cache is being invalidate because project 7bb60b0c62e54b8a9d0a129c9769d9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:48.377547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.378487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.380475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1339/2644] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:48 2022] DELETE /identity/v3/projects/7bb60b0c62e54b8a9d0a129c9769d9ff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:48.384218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.385732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.404778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.405764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.405764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.406015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] PATH_INFO: `/v3/projects/daed1cfc15f44dd2a100bbb59384303c/users/b89adccb9db346299c53ae530edb52e3/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.421588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daed1cfc15f44dd2a100bbb59384303c, user_id=b89adccb9db346299c53ae530edb52e3, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.424489 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.435661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:48.442631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1306/2645] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:48 2022] PUT /identity/v3/projects/daed1cfc15f44dd2a100bbb59384303c/users/b89adccb9db346299c53ae530edb52e3/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:48.446965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.449013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.461494 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9747-5592-42e7-abaa-bb6cc22eae1e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.516137 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b38e8-5148-474b-a83b-c44121c71126 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.518249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.519173 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.519477 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.519750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] PATH_INFO: `/v3/users/874ac8e7ed4241f0a89988e9036bdf87` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.520829 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.521003 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=874ac8e7ed4241f0a89988e9036bdf87)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.521594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.521872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.522140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.522861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.522969 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.524834 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.535046 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1307/2646] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:48.539184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.549271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e5ab4-8b7c-4104-a6fe-4c654af32181 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.554247 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fa766-bbe3-47ce-a132-2d8f558cb945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.555347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fa766-bbe3-47ce-a132-2d8f558cb945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.555643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fa766-bbe3-47ce-a132-2d8f558cb945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.556026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fa766-bbe3-47ce-a132-2d8f558cb945 admin admin] PATH_INFO: `/v3/projects/daed1cfc15f44dd2a100bbb59384303c/users/b89adccb9db346299c53ae530edb52e3/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.558458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fa766-bbe3-47ce-a132-2d8f558cb945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daed1cfc15f44dd2a100bbb59384303c, user_id=b89adccb9db346299c53ae530edb52e3, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.561820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fa766-bbe3-47ce-a132-2d8f558cb945 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.572328 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874ac8e7ed4241f0a89988e9036bdf87'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.573069 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1308/2647] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:48 2022] PUT /identity/v3/projects/daed1cfc15f44dd2a100bbb59384303c/users/b89adccb9db346299c53ae530edb52e3/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:48.582342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874ac8e7ed4241f0a89988e9036bdf87'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.583577 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874ac8e7ed4241f0a89988e9036bdf87'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.584186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.584465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.584730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.591474 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874ac8e7ed4241f0a89988e9036bdf87'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.592283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874ac8e7ed4241f0a89988e9036bdf87'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:48.610043 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1340/2648] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:48 2022] DELETE /identity/v3/users/874ac8e7ed4241f0a89988e9036bdf87 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:48.614011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] MFA Rules not processed for user `b89adccb9db346299c53ae530edb52e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:48.615340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.651905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:48.693422 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1309/2649] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:48.704459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.705943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.773898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494827-d83c-4f62-8b64-7cca181cd2f0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.777883 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400de1be-6925-471a-8f13-80f92a881099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.778511 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400de1be-6925-471a-8f13-80f92a881099 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.778826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400de1be-6925-471a-8f13-80f92a881099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.779119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400de1be-6925-471a-8f13-80f92a881099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.789706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400de1be-6925-471a-8f13-80f92a881099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.791171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400de1be-6925-471a-8f13-80f92a881099 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:48.800987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1341/2650] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:48.892965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:48.894835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:48.979307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e3ad-bec2-41d9-af33-1bd349e1eff1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:48.984571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:48.985588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:48.985855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:48.986131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] PATH_INFO: `/v3/projects/25cd7267b6264f44a60a8cee201f83b1` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:48.987444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=25cd7267b6264f44a60a8cee201f83b1)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:48.989396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.042389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25cd7267b6264f44a60a8cee201f83b1', 'request_id': 'req-677bc183-5684-4542-8a9f-1dd3aeb898ce'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.048543 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25cd7267b6264f44a60a8cee201f83b1', 'request_id': 'req-677bc183-5684-4542-8a9f-1dd3aeb898ce'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.062140 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25cd7267b6264f44a60a8cee201f83b1', 'request_id': 'req-677bc183-5684-4542-8a9f-1dd3aeb898ce'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.073931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] The token cache is being invalidate because project 25cd7267b6264f44a60a8cee201f83b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:49.074532 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.074814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-677bc183-5684-4542-8a9f-1dd3aeb898ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.076467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1310/2651] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:48 2022] DELETE /identity/v3/projects/25cd7267b6264f44a60a8cee201f83b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:49.081711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.081987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.082259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.100898 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:49.102122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.107728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:49.166576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1342/2652] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:49.177325 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.177749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.178139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.194356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.196553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.206869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:49.208152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.216487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56904d4-c413-4ca9-aa97-cf5ec6fb226b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.222853 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1311/2653] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:49.224072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.225284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.225564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.225840 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] PATH_INFO: `/v3/users/96a143dbe0c74dd98cd56683efe906b5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.227386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.227531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a143dbe0c74dd98cd56683efe906b5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.229956 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.237895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda51168-3ce4-40b6-8b0c-6f5467f990b0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.245713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.246395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.246654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.247240 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.248030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:49.248436 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.250235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.263933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1312/2654] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:48:49.269179 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.284930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e09a-6d5b-4638-9573-2b3579466c9c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.289820 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.290053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a143dbe0c74dd98cd56683efe906b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.290484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.290768 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.291078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.291784 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.293722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.298599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a143dbe0c74dd98cd56683efe906b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.299459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a143dbe0c74dd98cd56683efe906b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.307769 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a143dbe0c74dd98cd56683efe906b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.308459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27890109-f614-4021-8c61-81a37fc6f665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a143dbe0c74dd98cd56683efe906b5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.323453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1313/2655] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/projects => generated 395 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:49.327874 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.328397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1343/2656] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:49 2022] DELETE /identity/v3/users/96a143dbe0c74dd98cd56683efe906b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:49.329442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.332994 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.333282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.333559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.350536 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:49.351315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:49.352547 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.402369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5370f-9b86-46a4-a5f7-de3b9a40d3bf admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.423942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1344/2657] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:49.433693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.435073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.460387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.461071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.461369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.461636 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.462316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.463096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:49.464960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.486775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1314/2658] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:49.490812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.497100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c14595-d2b2-4548-8547-01b6ef11d009 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.500313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c18f7-199f-405a-939c-5b38ff65fe98 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.500750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.501408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.501692 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.501971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.505294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.506024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.506395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.506747 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.507599 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.509356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.511080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.512525 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.519823 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1315/2659] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:49.524041 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.526069 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1345/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:49.534096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf62c0-db9e-46b9-a54c-aa9f4ddb3e25 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.539082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734eb7a-d6c4-4431-b97e-06fac11fe71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.539744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734eb7a-d6c4-4431-b97e-06fac11fe71b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.540029 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734eb7a-d6c4-4431-b97e-06fac11fe71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.540303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734eb7a-d6c4-4431-b97e-06fac11fe71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.541027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734eb7a-d6c4-4431-b97e-06fac11fe71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.542663 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734eb7a-d6c4-4431-b97e-06fac11fe71b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.555487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1316/2661] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:49.559740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.570155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9590f8-abc9-4db9-9ac4-31700e73a76a service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.576588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.577508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.577786 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.578112 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] PATH_INFO: `/v3/projects/b226ff5ec82b42b390c75a9c5bbae91c/users/e24269b266db47f5a597e707e7cb816b/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.595594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b226ff5ec82b42b390c75a9c5bbae91c, user_id=e24269b266db47f5a597e707e7cb816b, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.598776 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.613548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1346/2662] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:49 2022] PUT /identity/v3/projects/b226ff5ec82b42b390c75a9c5bbae91c/users/e24269b266db47f5a597e707e7cb816b/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:49.624021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.624312 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.624710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.656345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] MFA Rules not processed for user `e24269b266db47f5a597e707e7cb816b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:49.657830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.726937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1317/2663] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:49.731693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.794240 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6d88-7289-474a-900b-be4a9ae01537 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.801732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.801732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.801732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.801732 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.802293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.803038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.804691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.805184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.821757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958d5e-0a02-457a-a08e-661a6439df3e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.830669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.831588 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.831785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.832055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] PATH_INFO: `/v3/projects/898a8b94af844e0b974a95484c58540f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.833303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898a8b94af844e0b974a95484c58540f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.835311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.838434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1347/2664] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:49.842767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.858221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:49.885596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898a8b94af844e0b974a95484c58540f', 'request_id': 'req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.891454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898a8b94af844e0b974a95484c58540f', 'request_id': 'req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.900115 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898a8b94af844e0b974a95484c58540f', 'request_id': 'req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.906458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324666a4-0ec5-4c1d-854c-f1f6e85db78b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.912348 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] The token cache is being invalidate because project 898a8b94af844e0b974a95484c58540f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:49.912628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.913265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:49.914838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1318/2665] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:49 2022] DELETE /identity/v3/projects/898a8b94af844e0b974a95484c58540f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:49.918676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.920027 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:49.940756 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:49.967176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.967875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.968200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.968640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.969463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.971621 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.985748 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e32d9-fa90-4c65-bdc2-1d8010e04fe4 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:49.991119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:49.992047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:49.992328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:49.992604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] PATH_INFO: `/v3/users/b89adccb9db346299c53ae530edb52e3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:49.996643 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1348/2666] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:49 2022] POST /identity/v3/users => generated 307 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:49.996813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89adccb9db346299c53ae530edb52e3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:49.996813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:49.997676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:49.999441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.011210 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e614e4-c415-4c39-b42f-69026df55dbf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.016555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.017220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.017493 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.017765 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.018491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.020147 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.034661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1349/2667] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:48:50.036315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.046539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe3e8-a6f2-4b70-9f95-1fb08eae615f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.051626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.051943 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89adccb9db346299c53ae530edb52e3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.052657 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.052998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.053331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] PATH_INFO: `/v3/projects/0a36fe1a436a4ea7b22f9fed73607f08/users/2505538366dd49de8879d6a0dafdffd9/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.060267 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89adccb9db346299c53ae530edb52e3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.061074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89adccb9db346299c53ae530edb52e3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.068837 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89adccb9db346299c53ae530edb52e3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.069180 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a36fe1a436a4ea7b22f9fed73607f08, user_id=2505538366dd49de8879d6a0dafdffd9, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.071890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.082049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89adccb9db346299c53ae530edb52e3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.087142 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1350/2668] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:50 2022] PUT /identity/v3/projects/0a36fe1a436a4ea7b22f9fed73607f08/users/2505538366dd49de8879d6a0dafdffd9/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:50.090333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1319/2669] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:49 2022] DELETE /identity/v3/users/b89adccb9db346299c53ae530edb52e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:50.091986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.093571 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.125318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:50.166066 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee114685-ad84-4533-9707-8a6f9296f141 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.171222 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2c5e8-c2f3-4f8a-ad76-6c432f6e08da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.171901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c5e8-c2f3-4f8a-ad76-6c432f6e08da admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.172182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c5e8-c2f3-4f8a-ad76-6c432f6e08da admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.172457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c5e8-c2f3-4f8a-ad76-6c432f6e08da admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.173210 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c5e8-c2f3-4f8a-ad76-6c432f6e08da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.174808 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c5e8-c2f3-4f8a-ad76-6c432f6e08da admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.185074 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1320/2670] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:50.189670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.258897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ecb0-41f6-4a5f-a2f3-0dc31312a870 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.263890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.264795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.265076 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.265347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] PATH_INFO: `/v3/projects/0a36fe1a436a4ea7b22f9fed73607f08/users/2505538366dd49de8879d6a0dafdffd9/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.267394 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a36fe1a436a4ea7b22f9fed73607f08, user_id=2505538366dd49de8879d6a0dafdffd9, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.270067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.281538 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1351/2671] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:50 2022] PUT /identity/v3/projects/0a36fe1a436a4ea7b22f9fed73607f08/users/2505538366dd49de8879d6a0dafdffd9/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:50.351294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.351528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.351737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.373188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.375623 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.390976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] MFA Rules not processed for user `2505538366dd49de8879d6a0dafdffd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:50.392225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.456263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0384c5-ded8-4069-b680-1bd338c3a8d3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.461520 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.462504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.462854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.463233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] PATH_INFO: `/v3/projects/daed1cfc15f44dd2a100bbb59384303c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.464534 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daed1cfc15f44dd2a100bbb59384303c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.465801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1321/2672] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:50.466465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.476276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.477634 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.499242 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:50.518519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daed1cfc15f44dd2a100bbb59384303c', 'request_id': 'req-536d6ad3-c26b-4919-b9ad-a3d7df357db1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.527442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daed1cfc15f44dd2a100bbb59384303c', 'request_id': 'req-536d6ad3-c26b-4919-b9ad-a3d7df357db1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.534488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daed1cfc15f44dd2a100bbb59384303c', 'request_id': 'req-536d6ad3-c26b-4919-b9ad-a3d7df357db1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.536044 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b030f-a8e6-46a1-acd4-4c4d892a4527 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.546198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] The token cache is being invalidate because project daed1cfc15f44dd2a100bbb59384303c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:50.546516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.547232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-536d6ad3-c26b-4919-b9ad-a3d7df357db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:50.548979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1352/2673] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:50 2022] DELETE /identity/v3/projects/daed1cfc15f44dd2a100bbb59384303c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:50.554158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811395e-cb02-46b5-92d8-f12376b662ab None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.554469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811395e-cb02-46b5-92d8-f12376b662ab None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.554740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811395e-cb02-46b5-92d8-f12376b662ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.572512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8811395e-cb02-46b5-92d8-f12376b662ab None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:50.573728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8811395e-cb02-46b5-92d8-f12376b662ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.590428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.591228 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.591507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.591836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.593885 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.613303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:50.643124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1353/2674] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:50.667170 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.668759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.680741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1322/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:50.707958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.708276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.708559 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.727892 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:50.729198 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.738426 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1354/2676] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:50.743127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.757789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f9dc-a1ef-49f6-b83d-199ddc984442 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.762604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.763306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.763593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.764754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.765533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.766269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:50.766579 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.767042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.768294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.779808 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8728f6-ee86-4890-930c-2ff0c9b26d3c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.781079 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1323/2677] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:50.785577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.786016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.786663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.786972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.787285 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.789115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:50.796150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c7d2-72ca-4d69-9685-ecd7d5543da9 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.801474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.802124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.802454 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.802726 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.803462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.805373 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.833291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1324/2678] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:50.837981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.854839 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.856459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.867186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1355/2679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:50.903633 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec0ed-e4a2-4c5f-856a-0c120019fcb0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.909958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.910647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.910929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.911213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.911905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.913824 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.938250 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1325/2680] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:50 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:48:50.942601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.954720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67884b1e-8116-47dd-9b36-e15e5b6e86bf service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:50.961391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:50.962408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:50.962739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:50.963124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:50.963868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:50.965919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:50.979544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1356/2681] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:50.981527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:50.992844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ef9f-8925-45a5-bbf0-a9d0e571cca5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:51.000517 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f9913-0cae-415a-9a87-532b1c777ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:51.001226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9913-0cae-415a-9a87-532b1c777ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:51.001512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9913-0cae-415a-9a87-532b1c777ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:51.001792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f9913-0cae-415a-9a87-532b1c777ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:51.002528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9913-0cae-415a-9a87-532b1c777ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:51.004592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f9913-0cae-415a-9a87-532b1c777ad2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:51.017110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1326/2682] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:51.021913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:51.033565 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fdf1f-b5f5-47d9-8375-e564ed8b7adb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:51.038745 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:51.039685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:51.039971 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:51.040250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] PATH_INFO: `/v3/projects/d16032805a954eb584420a8928234607/users/5dcda1dbadb64bd790548d72d3e469eb/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:51.056871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16032805a954eb584420a8928234607, user_id=5dcda1dbadb64bd790548d72d3e469eb, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:51.059602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:51.075033 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1357/2683] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:51 2022] PUT /identity/v3/projects/d16032805a954eb584420a8928234607/users/5dcda1dbadb64bd790548d72d3e469eb/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:51.085934 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:51.086428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:51.086535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:51.115686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] MFA Rules not processed for user `5dcda1dbadb64bd790548d72d3e469eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:51.117024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:51.172504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:51.194628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1327/2684] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:51.206144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:51.219055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:51.274958 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e734-2417-45f0-a210-671eeacc791b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:51.279980 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b08d86-818d-4291-8390-f386f8fd9da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:51.280702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08d86-818d-4291-8390-f386f8fd9da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:51.281244 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08d86-818d-4291-8390-f386f8fd9da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:51.281539 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b08d86-818d-4291-8390-f386f8fd9da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:51.291225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b08d86-818d-4291-8390-f386f8fd9da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:51.292696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b08d86-818d-4291-8390-f386f8fd9da9 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:51.302445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1358/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:48:54.948190 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:54.950691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:55.025785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86566e-75a8-43dd-bbb2-a7322467682f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:55.031604 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:55.032649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:55.032956 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:55.033244 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] PATH_INFO: `/v3/users/e24269b266db47f5a597e707e7cb816b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:55.034577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24269b266db47f5a597e707e7cb816b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:55.036547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:55.105760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24269b266db47f5a597e707e7cb816b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.114760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24269b266db47f5a597e707e7cb816b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.115495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24269b266db47f5a597e707e7cb816b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.122692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24269b266db47f5a597e707e7cb816b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.135038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24269b266db47f5a597e707e7cb816b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.141132 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1328/2686] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:54 2022] DELETE /identity/v3/users/e24269b266db47f5a597e707e7cb816b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:55.145979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:55.146487 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:55.146626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:55.166121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:55.167415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:55.232708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1359/2687] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:55.246061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:55.247761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:55.312969 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2aa3a-d6e5-4db3-adb6-13aac0cf400f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:55.316917 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:55.317568 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:55.317844 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:55.318110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:55.327340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:55.328781 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:55.338144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1329/2688] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:48:55.882778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:55.884337 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:55.898156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225877-ca88-4c48-85a0-5b6f51a29b52 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:55.905423 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:55.906551 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:55.919800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:55.920209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] PATH_INFO: `/v3/projects/b226ff5ec82b42b390c75a9c5bbae91c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:55.921708 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b226ff5ec82b42b390c75a9c5bbae91c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:55.924445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:55.975469 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b226ff5ec82b42b390c75a9c5bbae91c', 'request_id': 'req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.983555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b226ff5ec82b42b390c75a9c5bbae91c', 'request_id': 'req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:55.990955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b226ff5ec82b42b390c75a9c5bbae91c', 'request_id': 'req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.002543 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] The token cache is being invalidate because project b226ff5ec82b42b390c75a9c5bbae91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:56.002836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.003517 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.006178 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1360/2689] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:55 2022] DELETE /identity/v3/projects/b226ff5ec82b42b390c75a9c5bbae91c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:56.010147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.020389 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600db10-b0f0-4aae-bd9d-db9be3083beb service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:56.025739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:56.081088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:56.081880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.082143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.082407 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] PATH_INFO: `/v3/users/2505538366dd49de8879d6a0dafdffd9` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.083696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2505538366dd49de8879d6a0dafdffd9)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:56.085645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:56.135465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2505538366dd49de8879d6a0dafdffd9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.144715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2505538366dd49de8879d6a0dafdffd9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.145406 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2505538366dd49de8879d6a0dafdffd9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.152981 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2505538366dd49de8879d6a0dafdffd9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.165696 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0e5ccdc-b5c2-4458-8a0c-b48abf9a2dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2505538366dd49de8879d6a0dafdffd9'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.171660 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1330/2690] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:48:56 2022] DELETE /identity/v3/users/2505538366dd49de8879d6a0dafdffd9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:56.456152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.458584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:56.472792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1c9c-b01d-45c3-b8f3-f4b0867f045f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:56.507743 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:56.532711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:56.533790 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.534177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.534513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] PATH_INFO: `/v3/projects/0a36fe1a436a4ea7b22f9fed73607f08` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.535762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a36fe1a436a4ea7b22f9fed73607f08)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:56.537711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:56.587846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a36fe1a436a4ea7b22f9fed73607f08', 'request_id': 'req-09c1afbf-278f-4f2e-a304-d32a64249dbe'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.596998 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a36fe1a436a4ea7b22f9fed73607f08', 'request_id': 'req-09c1afbf-278f-4f2e-a304-d32a64249dbe'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.604037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a36fe1a436a4ea7b22f9fed73607f08', 'request_id': 'req-09c1afbf-278f-4f2e-a304-d32a64249dbe'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.618074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] The token cache is being invalidate because project 0a36fe1a436a4ea7b22f9fed73607f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:48:56.618383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.619139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-09c1afbf-278f-4f2e-a304-d32a64249dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:48:56.621006 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1361/2691] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:48:56 2022] DELETE /identity/v3/projects/0a36fe1a436a4ea7b22f9fed73607f08 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:48:56.626617 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.626903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.627221 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.648249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:56.649930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:56.712108 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1331/2692] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:56.720141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.720575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.720678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.740689 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:56.741933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:56.751231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1362/2693] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:48:56.755838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.767978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcf1a3-cd23-42aa-90eb-51d6cfe69501 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:56.771220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:56.771918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.772197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.772469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.773226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:48:56.773535 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:56.775530 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:56.787994 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1332/2694] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:48:56.792611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.802275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47844-d6c7-4d1c-b052-dfd35f48ca5e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:56.807490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:56.808186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.808458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.808740 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.809437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:56.811458 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:56.843024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1363/2695] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:48:56 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:56.844233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.855333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c3706-778b-46d8-ad24-e03c41d29b03 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:56.867367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:56.917529 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:56.918220 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.918645 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.918970 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.919686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:56.921622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:56.943764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1333/2696] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:48:56 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:48:56.948171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.959219 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f5666-f073-4927-9239-5f30025ac6c2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:56.964224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:56.964882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:56.965164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:56.965441 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:56.966176 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:56.967843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:56.983171 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1364/2697] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:56.984717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:56.995504 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7219440-4ec7-4c7d-b77d-7907fdff8d7c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:57.001061 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89654401-39ee-4c9e-af61-409232a4f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:57.001833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89654401-39ee-4c9e-af61-409232a4f7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:57.002099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89654401-39ee-4c9e-af61-409232a4f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:57.002367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89654401-39ee-4c9e-af61-409232a4f7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:57.003427 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89654401-39ee-4c9e-af61-409232a4f7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:57.005123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89654401-39ee-4c9e-af61-409232a4f7d9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:57.019038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1334/2698] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:48:57.020989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:57.032857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17dba0-802e-45d4-8334-b951da475ade admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:57.037773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:57.038671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:57.038966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:57.039271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] PATH_INFO: `/v3/projects/6e9a6696f0b542f4a78b3fdcb8a785ed/users/8f9c4a85f7b744239836b0cb9eda22ae/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:57.054700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9a6696f0b542f4a78b3fdcb8a785ed, user_id=8f9c4a85f7b744239836b0cb9eda22ae, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:57.057437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:57.071805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1365/2699] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:48:57 2022] PUT /identity/v3/projects/6e9a6696f0b542f4a78b3fdcb8a785ed/users/8f9c4a85f7b744239836b0cb9eda22ae/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:48:57.087033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:57.087033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:57.087033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:57.110709 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] MFA Rules not processed for user `8f9c4a85f7b744239836b0cb9eda22ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:48:57.112147 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:57.182606 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1335/2700] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:48:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:48:57.193215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:48:57.195152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:48:57.254146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbce9de-95c4-4907-9936-a9c4fe853db7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:48:57.257815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1d0b-a516-4813-9b76-a4b6be7bd4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:48:57.258495 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1d0b-a516-4813-9b76-a4b6be7bd4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:48:57.258782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1d0b-a516-4813-9b76-a4b6be7bd4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:48:57.259073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1d0b-a516-4813-9b76-a4b6be7bd4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:48:57.268254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1d0b-a516-4813-9b76-a4b6be7bd4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:48:57.269700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1d0b-a516-4813-9b76-a4b6be7bd4d7 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:48:57.279088 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1366/2701] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:48:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:00.355723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:00.420010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb3a9-1a9d-4478-9295-8d5dd0727ce1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:00.425277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:00.426166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:00.426451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:00.426722 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] PATH_INFO: `/v3/users/8f9c4a85f7b744239836b0cb9eda22ae` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:00.428056 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9c4a85f7b744239836b0cb9eda22ae)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:00.430013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:00.466860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:00.490983 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9c4a85f7b744239836b0cb9eda22ae'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:00.500686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9c4a85f7b744239836b0cb9eda22ae'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:00.501440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9c4a85f7b744239836b0cb9eda22ae'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:00.508522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9c4a85f7b744239836b0cb9eda22ae'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:00.521342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9c4a85f7b744239836b0cb9eda22ae'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:00.527836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1336/2702] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:49:00 2022] DELETE /identity/v3/users/8f9c4a85f7b744239836b0cb9eda22ae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:00.532442 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:00.532978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:00.532978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:00.545599 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:00.552558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:00.554512 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:00.618847 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1367/2703] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:00.628998 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:00.630570 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:00.690450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c49d-c086-4a36-a181-86b83392b212 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:00.695260 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e02c5-f3c8-446e-8dc2-2bc62a7a3cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:00.695919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e02c5-f3c8-446e-8dc2-2bc62a7a3cde service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:00.696202 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e02c5-f3c8-446e-8dc2-2bc62a7a3cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:00.696479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e02c5-f3c8-446e-8dc2-2bc62a7a3cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:00.706462 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e02c5-f3c8-446e-8dc2-2bc62a7a3cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:00.707933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e02c5-f3c8-446e-8dc2-2bc62a7a3cde service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:00.717786 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1337/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:01.021036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.022665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.036135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95fc47-6a42-464c-8c5e-4afed40fe568 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.042355 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.043275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.043550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.043816 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] PATH_INFO: `/v3/projects/6e9a6696f0b542f4a78b3fdcb8a785ed` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.045114 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9a6696f0b542f4a78b3fdcb8a785ed)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.047358 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.115098 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9a6696f0b542f4a78b3fdcb8a785ed', 'request_id': 'req-bc829fe9-5db4-45b3-8160-7265747ad835'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.124473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9a6696f0b542f4a78b3fdcb8a785ed', 'request_id': 'req-bc829fe9-5db4-45b3-8160-7265747ad835'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.130336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9a6696f0b542f4a78b3fdcb8a785ed', 'request_id': 'req-bc829fe9-5db4-45b3-8160-7265747ad835'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.147158 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] The token cache is being invalidate because project 6e9a6696f0b542f4a78b3fdcb8a785ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:49:01.147460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.148256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc829fe9-5db4-45b3-8160-7265747ad835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.150368 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1368/2705] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:49:01 2022] DELETE /identity/v3/projects/6e9a6696f0b542f4a78b3fdcb8a785ed => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:01.155667 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.155960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.156238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.177189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:01.178442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.242014 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1338/2706] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:01.255258 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.255545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.255844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.276191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:01.277429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.287103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1369/2707] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:01.291503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.301932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635ff0-69d9-4320-a38d-aab088661592 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.307813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.308484 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.308759 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.309059 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.309797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:49:01.310094 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.311741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.324843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1339/2708] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:49:01.329914 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.344833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2aafb-811a-4b68-b898-116dbf77db35 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.351013 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.351702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.351977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.352241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.352924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.354823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.381802 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.382971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.384245 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1370/2709] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:49:01.388650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.402611 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724c90-9ccf-45da-bcac-11f1541d9192 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.434252 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:01.456513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e935d-c74f-48bf-960c-f59494975a7c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.461436 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.462129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.462409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.462722 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.463421 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.464841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.465575 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.465716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.466012 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.466238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] PATH_INFO: `/v3/users/5dcda1dbadb64bd790548d72d3e469eb` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.467527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcda1dbadb64bd790548d72d3e469eb)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.469825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.473564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:01.492774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1371/2710] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:49:01.493755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.503640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f53df-0430-43e7-97e7-6e62c56470e7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.509433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.509996 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.510351 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.510634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.511406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.513021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.522558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcda1dbadb64bd790548d72d3e469eb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.524290 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1372/2711] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:49:01.528378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.534626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcda1dbadb64bd790548d72d3e469eb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.535313 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcda1dbadb64bd790548d72d3e469eb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.538353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24776dc-1eec-4e97-8cff-7370379b6213 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.542544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcda1dbadb64bd790548d72d3e469eb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.543096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.543838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.544169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.544516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.545309 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.547212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.555780 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-311f95bb-120d-4784-a8a3-4a6bb39979f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcda1dbadb64bd790548d72d3e469eb'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:01.557938 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1373/2712] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:49:01.561997 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.562253 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1340/2713] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:49:01 2022] DELETE /identity/v3/users/5dcda1dbadb64bd790548d72d3e469eb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:01.563813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.566608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.566894 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.567201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.576470 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d507be-3c52-46d8-a1fa-9949fd330c86 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.585198 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:01.586398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.634037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a6407-ab37-4a73-96a2-3719d45e23bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.635100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6407-ab37-4a73-96a2-3719d45e23bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.635378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6407-ab37-4a73-96a2-3719d45e23bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.635646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a6407-ab37-4a73-96a2-3719d45e23bb admin admin] PATH_INFO: `/v3/projects/266e04b3fe7d43dfa950f0ffb6c55b0c/users/8f471238644b4af6a6297006528aeffc/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.654660 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6407-ab37-4a73-96a2-3719d45e23bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=266e04b3fe7d43dfa950f0ffb6c55b0c, user_id=8f471238644b4af6a6297006528aeffc, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.657673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a6407-ab37-4a73-96a2-3719d45e23bb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.662053 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1341/2714] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:01.672805 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.674387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.679266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1374/2715] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:49:01 2022] PUT /identity/v3/projects/266e04b3fe7d43dfa950f0ffb6c55b0c/users/8f471238644b4af6a6297006528aeffc/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:49:01.690679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.691199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.691479 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.722342 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] MFA Rules not processed for user `8f471238644b4af6a6297006528aeffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:01.723789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:01.739183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f8c86-6cc2-4ae1-bf83-efee201821fd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.744200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:01.797102 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.797758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.798042 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.798316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.799796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1375/2716] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:01.804302 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.848488 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:01.859880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.861349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.868531 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85efe1-ae43-4942-8c37-86e0847a1d07 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.871083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1342/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:49:01.877200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.877934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.878202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.878480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.879209 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.881192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:01.910120 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1376/2718] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:49:01.914209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:01.924757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f1f1d-17b9-44f8-af1f-332c3ca0d4e2 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:01.984237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:01.985028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:01.985306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:01.985582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:01.986296 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:01.988362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.013154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1343/2719] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:49:01 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:49:02.015266 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.026682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5d441-9d32-4e73-8049-7248099bec52 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.032146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.032796 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.033080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.033347 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.034106 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.035943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.049344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1377/2720] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:49:02.052497 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.063088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158a75e-9814-4002-ab29-881a6993b65c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.068725 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.069434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.069714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.069984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.070690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.072345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.086172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1344/2721] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:49:02.090452 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.101504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac994a-277e-4af3-aa2d-8cf740174b40 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.106851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574d7d-783b-4c17-a6dd-8603f10e2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.107806 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574d7d-783b-4c17-a6dd-8603f10e2802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.108090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574d7d-783b-4c17-a6dd-8603f10e2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.108406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574d7d-783b-4c17-a6dd-8603f10e2802 admin admin] PATH_INFO: `/v3/projects/3ddeb04cdf8c4efb8f2047e355921e8c/users/9298437ae16045afb80616dcab74d5b3/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.125604 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574d7d-783b-4c17-a6dd-8603f10e2802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddeb04cdf8c4efb8f2047e355921e8c, user_id=9298437ae16045afb80616dcab74d5b3, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.128638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574d7d-783b-4c17-a6dd-8603f10e2802 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.144999 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1378/2722] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:49:02 2022] PUT /identity/v3/projects/3ddeb04cdf8c4efb8f2047e355921e8c/users/9298437ae16045afb80616dcab74d5b3/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:02.154713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.155908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.156200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.156475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.157289 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.176931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b8e5-ec51-42d7-868e-0d1c1d8efbf5 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.185838 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] MFA Rules not processed for user `9298437ae16045afb80616dcab74d5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:02.187094 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.220558 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:02.245905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.246812 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.247116 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.247385 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] PATH_INFO: `/v3/projects/d16032805a954eb584420a8928234607` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.248755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16032805a954eb584420a8928234607)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.250669 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.252030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1379/2723] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:02.256807 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.268067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7553a-d5fa-4986-a141-e2405fa87883 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.272767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.273422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.273703 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.274312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.275019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.277021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.300124 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16032805a954eb584420a8928234607', 'request_id': 'req-5be0cbb7-64b2-4f96-97c2-2498132e45fc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:02.305079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1380/2724] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:49:02.306105 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16032805a954eb584420a8928234607', 'request_id': 'req-5be0cbb7-64b2-4f96-97c2-2498132e45fc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:02.309457 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.315987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16032805a954eb584420a8928234607', 'request_id': 'req-5be0cbb7-64b2-4f96-97c2-2498132e45fc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:02.327550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] The token cache is being invalidate because project d16032805a954eb584420a8928234607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:49:02.327865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:02.328523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5be0cbb7-64b2-4f96-97c2-2498132e45fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:02.330201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1345/2725] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:49:02 2022] DELETE /identity/v3/projects/d16032805a954eb584420a8928234607 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:02.334961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db88b8-2ed3-4e07-8153-1670a028ba10 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.335263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db88b8-2ed3-4e07-8153-1670a028ba10 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.335539 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db88b8-2ed3-4e07-8153-1670a028ba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.353113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e3db88b8-2ed3-4e07-8153-1670a028ba10 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:02.354316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e3db88b8-2ed3-4e07-8153-1670a028ba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.378407 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c33853-0fc9-41a4-9cc8-8bccb7b9dfba admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.383371 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.384067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.384344 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.384611 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.385298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.387222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.394037 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:02.409913 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1381/2726] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:49:02.414061 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.415803 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.422551 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1346/2727] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:02.428102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe5be-e4f5-4195-b665-d86ed22b3be3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.431550 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.431833 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.432104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.433723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.434438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.434723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.435016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.435775 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.437403 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.452283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1382/2728] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:49:02.452506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:02.452506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.453825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.460035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1347/2729] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:02.464019 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee28664-ef37-429e-a574-af2ef9bb67e9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.464151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.468792 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.469693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.469963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.470237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] PATH_INFO: `/v3/projects/1c4dace8dd144fbeb053feeab7847215/users/e8b238aac0ca45d285eaa1cbb3fd5e90/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.473127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c9dfc-0f35-47a0-af2c-6292ff066927 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.477928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.478575 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.478878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.479292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.480094 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:49:02.480404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.482039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.486391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4dace8dd144fbeb053feeab7847215, user_id=e8b238aac0ca45d285eaa1cbb3fd5e90, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.489434 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.495057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1348/2730] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:49:02.499815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.504387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1383/2731] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:49:02 2022] PUT /identity/v3/projects/1c4dace8dd144fbeb053feeab7847215/users/e8b238aac0ca45d285eaa1cbb3fd5e90/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:02.508102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.510057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30042-7314-4f78-95a2-0658448a18df admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.555474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:02.569513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.569734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2f96c-136b-410a-ae8d-2ae1352a991c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.570897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.571207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.571478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.572187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.574138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.574522 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.575237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.575523 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.575805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.576545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.578859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.589750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1384/2732] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:49:02.595466 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.600952 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1349/2733] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:49:02.604918 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.606100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960dde7-12dd-45ea-a844-c835a433484d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.665174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f64e4b-47d0-40f4-a722-f150a474a22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.666015 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f64e4b-47d0-40f4-a722-f150a474a22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.666293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f64e4b-47d0-40f4-a722-f150a474a22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.666568 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f64e4b-47d0-40f4-a722-f150a474a22c admin admin] PATH_INFO: `/v3/projects/1c4dace8dd144fbeb053feeab7847215/users/e8b238aac0ca45d285eaa1cbb3fd5e90/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.668091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919473e-7555-4dd8-aa01-f04a0892d453 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.668581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f64e4b-47d0-40f4-a722-f150a474a22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4dace8dd144fbeb053feeab7847215, user_id=e8b238aac0ca45d285eaa1cbb3fd5e90, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.671304 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f64e4b-47d0-40f4-a722-f150a474a22c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.672957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.673653 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.673935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.674265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.675064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.677000 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.682235 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1385/2734] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:49:02 2022] PUT /identity/v3/projects/1c4dace8dd144fbeb053feeab7847215/users/e8b238aac0ca45d285eaa1cbb3fd5e90/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:49:02.694447 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.695066 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.695472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.702417 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1350/2735] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:49:02.703416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.713971 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c877a-b457-4699-bf57-c22a63c2a2a2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.723056 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] MFA Rules not processed for user `e8b238aac0ca45d285eaa1cbb3fd5e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:02.724261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.757048 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:02.772263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.772955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.773234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.773503 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.774624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.776290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.786622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1351/2736] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:49:02.790582 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.800151 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41569da-07f8-4240-9389-057e4f35f963 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.800926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1386/2737] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:02.804739 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.805478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.805751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.806022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.806772 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.808428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.813109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.815044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.818978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1352/2738] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:49:02.823172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.832859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccafcc-23b8-4063-a6e3-d8badd9bd191 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.837600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e794095-b71e-4f1f-a228-4a7c605e9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.838468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e794095-b71e-4f1f-a228-4a7c605e9ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.838752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e794095-b71e-4f1f-a228-4a7c605e9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.839057 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e794095-b71e-4f1f-a228-4a7c605e9ea2 admin admin] PATH_INFO: `/v3/projects/3f081b7689254dbc9924920c9b197333/users/82481f9693ca4071846774faed1d2af0/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.853840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e794095-b71e-4f1f-a228-4a7c605e9ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f081b7689254dbc9924920c9b197333, user_id=82481f9693ca4071846774faed1d2af0, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.856613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e794095-b71e-4f1f-a228-4a7c605e9ea2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:02.872554 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1353/2739] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:49:02 2022] PUT /identity/v3/projects/3f081b7689254dbc9924920c9b197333/users/82481f9693ca4071846774faed1d2af0/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:49:02.876324 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71992346-fbfa-46b8-acc2-f4baaf48f1f1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:02.878085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.878483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.878760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.896718 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:02.898034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.917160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:02.927475 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:02.928138 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:02.928420 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:02.928693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:02.930541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.958643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1354/2740] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:02.968479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:02.971262 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:02.991606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:02.993058 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721e4c7-07ec-4b2e-b5bf-0cf05d7e410d service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:03.002292 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1387/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:49:03.029188 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439ad1-5edd-4783-8b35-94f2e07a73db None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:03.033350 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:03.034073 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:03.034354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:03.034629 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:03.044362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:03.045879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:03.056224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1355/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:49:03.711148 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:03.711785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:03.711785 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:03.740767 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] MFA Rules not processed for user `82481f9693ca4071846774faed1d2af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:03.742018 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:03.776360 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:03.816326 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1388/2743] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:03.834682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:03.845643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9058e-24bf-4db7-8ee3-01414ee02862 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:03.849793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:03.850450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:03.850730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:03.851026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:03.860859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:03.862353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:03.872099 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1356/2744] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:04.514777 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:04.517202 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:04.532922 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e8382-e7bc-4906-bc9c-a7d5fa1a7369 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:04.537966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:04.538614 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:04.538919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:04.539221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:04.541963 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:04.609860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:04.611215 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d1b82-fe63-439c-8d47-1d225dc7fe4b service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:04.620884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1389/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:05.183967 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:05.195610 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebbc39-deee-4829-979c-cce5f3e34345 service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:05.200537 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:05.201211 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:05.201486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:05.201755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:05.261711 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:05.262634 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:05.263096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:05.284110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] MFA Rules not processed for user `82481f9693ca4071846774faed1d2af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:05.285331 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:05.291719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:05.292613 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1390/2746] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:05.297022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:05.304328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1357/2747] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:05.332965 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:05.334445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:05.397415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c017160-aea7-4b79-a36c-1d65d063889e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:05.402055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:05.402713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:05.403031 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:05.403492 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:05.407226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:05.485704 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:05.487239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:05.498345 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1391/2748] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:05.721365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:05.736791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ecd4-043b-436a-be26-5470c05e62db service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:05.741354 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:05.742018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:05.742302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:05.742573 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:05.744478 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:05.754711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:05.756178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:05.764451 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1358/2749] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:49:06.108254 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:06.110127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:06.115500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:06.121841 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:06.123343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:06.134103 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067c1f9-303a-4f20-9150-9680ab47c94a service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:06.138257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:06.138904 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:06.139238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:06.139509 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:06.141905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:06.157713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:06.159329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:06.170602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1359/2750] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:06.185223 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c04b90-a38a-4ce4-bb37-963d8ff5cb93 service glance] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:06.191191 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:06.191859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:06.192139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:06.192418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:06.194300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:06.206766 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:06.208327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:06.219059 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1392/2751] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:08.233849 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:08.244197 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a987b-d666-44a2-b57e-073caff24ba2 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:08.249278 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:08.249974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:08.250257 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:08.250519 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:08.252426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:08.262674 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:08.264155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:08.272764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1360/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:08.895250 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:08.897243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:08.914246 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e0437-41ed-4938-94e7-1847668a6546 service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:08.920074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:08.920723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:08.921002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:08.921275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:08.923793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:08.937036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:08.938644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1fff9-1c4e-43f0-b489-856080c735ad service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:08.949793 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1393/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:09.179880 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:09.195688 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22344f0-1c5d-41b6-97d2-46db044f69b4 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:09.201851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:09.202744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:09.203055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:09.203330 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] PATH_INFO: `/v3/users/8f471238644b4af6a6297006528aeffc` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:09.204642 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f471238644b4af6a6297006528aeffc)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:09.206680 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:09.209307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:09.256499 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f471238644b4af6a6297006528aeffc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.264705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f471238644b4af6a6297006528aeffc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.265393 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f471238644b4af6a6297006528aeffc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.272900 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f471238644b4af6a6297006528aeffc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.287129 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f471238644b4af6a6297006528aeffc'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.293553 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1361/2754] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:49:09 2022] DELETE /identity/v3/users/8f471238644b4af6a6297006528aeffc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:09.298224 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:09.298514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:09.298791 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:09.317742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:09.319650 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:09.383409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1394/2755] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:09.394875 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:09.396383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:09.455096 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e25b-5912-4d07-9719-09c9893af92c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:09.460113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:09.460813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:09.461369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:09.461369 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:09.475567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:09.477803 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:09.490848 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1362/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:09.768570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:09.770016 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:09.785334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb979581-fb60-4cb0-b6c8-27115747820f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:09.791139 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:09.791988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:09.792323 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:09.792586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] PATH_INFO: `/v3/projects/266e04b3fe7d43dfa950f0ffb6c55b0c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:09.793859 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266e04b3fe7d43dfa950f0ffb6c55b0c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:09.795931 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:09.849318 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266e04b3fe7d43dfa950f0ffb6c55b0c', 'request_id': 'req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.859405 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266e04b3fe7d43dfa950f0ffb6c55b0c', 'request_id': 'req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.865319 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266e04b3fe7d43dfa950f0ffb6c55b0c', 'request_id': 'req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.877109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] The token cache is being invalidate because project 266e04b3fe7d43dfa950f0ffb6c55b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:49:09.877422 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.878100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:09.879795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1395/2757] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:49:09 2022] DELETE /identity/v3/projects/266e04b3fe7d43dfa950f0ffb6c55b0c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:09.884021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:09.893942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780fac6-0603-456a-ac99-8a6beca1569e service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:09.952303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:09.953176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:09.953474 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:09.953717 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] PATH_INFO: `/v3/users/9298437ae16045afb80616dcab74d5b3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:09.954916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9298437ae16045afb80616dcab74d5b3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:09.956955 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:09.986481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:10.008933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9298437ae16045afb80616dcab74d5b3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.017766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9298437ae16045afb80616dcab74d5b3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.018468 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9298437ae16045afb80616dcab74d5b3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.025974 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9298437ae16045afb80616dcab74d5b3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.039082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9298437ae16045afb80616dcab74d5b3'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.046172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1363/2758] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:49:09 2022] DELETE /identity/v3/users/9298437ae16045afb80616dcab74d5b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:10.327682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:10.329168 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:10.337500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:10.344642 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55397-13c3-447b-b76e-1e3dc8b0a1a5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:10.407413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:10.408275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:10.408558 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:10.408826 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] PATH_INFO: `/v3/projects/3ddeb04cdf8c4efb8f2047e355921e8c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:10.410082 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddeb04cdf8c4efb8f2047e355921e8c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:10.412038 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:10.477721 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddeb04cdf8c4efb8f2047e355921e8c', 'request_id': 'req-c401ff9a-3763-4e33-a09c-3a69b9156e1f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.487418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddeb04cdf8c4efb8f2047e355921e8c', 'request_id': 'req-c401ff9a-3763-4e33-a09c-3a69b9156e1f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.493338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddeb04cdf8c4efb8f2047e355921e8c', 'request_id': 'req-c401ff9a-3763-4e33-a09c-3a69b9156e1f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.504720 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] The token cache is being invalidate because project 3ddeb04cdf8c4efb8f2047e355921e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:49:10.505007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.505645 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.507236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1396/2759] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:49:10 2022] DELETE /identity/v3/projects/3ddeb04cdf8c4efb8f2047e355921e8c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:10.511339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:10.512826 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:10.526703 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ed750-2649-4c9e-a644-a1ffefa76382 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:10.585681 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:10.586472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:10.586745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:10.587015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] PATH_INFO: `/v3/users/e8b238aac0ca45d285eaa1cbb3fd5e90` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:10.588282 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b238aac0ca45d285eaa1cbb3fd5e90)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:10.590217 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:10.651343 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b238aac0ca45d285eaa1cbb3fd5e90'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.661714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b238aac0ca45d285eaa1cbb3fd5e90'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.662673 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b238aac0ca45d285eaa1cbb3fd5e90'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.674346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b238aac0ca45d285eaa1cbb3fd5e90'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.696383 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b238aac0ca45d285eaa1cbb3fd5e90'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:10.703459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1364/2760] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:49:10 2022] DELETE /identity/v3/users/e8b238aac0ca45d285eaa1cbb3fd5e90 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:11.068526 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:11.070075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:11.086578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ff9a-3763-4e33-a09c-3a69b9156e1f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:11.143233 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:11.144052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:11.144329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:11.144602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] PATH_INFO: `/v3/projects/1c4dace8dd144fbeb053feeab7847215` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:11.146024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4dace8dd144fbeb053feeab7847215)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:11.148053 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:11.189514 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:11.201617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4dace8dd144fbeb053feeab7847215', 'request_id': 'req-5e877508-2f41-4624-afe9-455a41f3ea24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:11.210749 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4dace8dd144fbeb053feeab7847215', 'request_id': 'req-5e877508-2f41-4624-afe9-455a41f3ea24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:11.216725 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4dace8dd144fbeb053feeab7847215', 'request_id': 'req-5e877508-2f41-4624-afe9-455a41f3ea24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:11.229509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] The token cache is being invalidate because project 1c4dace8dd144fbeb053feeab7847215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:49:11.229817 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:11.230607 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5e877508-2f41-4624-afe9-455a41f3ea24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:49:11.232300 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1397/2761] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:49:11 2022] DELETE /identity/v3/projects/1c4dace8dd144fbeb053feeab7847215 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:49:14.547737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:14.549224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:14.578960 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:14.641893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4387c7e-3845-49b2-9aa6-3e61bcc8765d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:14.706947 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:14.707650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:14.707929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:14.708200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:14.710490 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:14.723872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:14.725589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97096596-9af9-4b07-84b2-7ebddc714186 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:14.740789 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1365/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:21.225730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:24.733121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=52 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:34.805275 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:34.805789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:34.805789 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:34.824192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] MFA Rules not processed for user `c9eeca4826c344c5bb62eec21ccba6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:34.825397 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:34.879917 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1398/2763] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:38.350032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5311-fc7f-4bc0-8115-60faf4c46daf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:38.350577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5311-fc7f-4bc0-8115-60faf4c46daf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:38.356349 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5311-fc7f-4bc0-8115-60faf4c46daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:38.382171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-492f5311-fc7f-4bc0-8115-60faf4c46daf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:38.383528 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-492f5311-fc7f-4bc0-8115-60faf4c46daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:38.450315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1366/2764] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:38.471738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:38.473339 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:38.491627 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c27bc1-e34b-486e-ba86-bf96646acf3f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:38.497338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:38.498008 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:38.498293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:38.498595 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:38.508049 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:38.509970 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:38.526087 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1399/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:41.447609 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:41.448175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:41.448175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:41.466937 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:41.468153 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:41.476364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1367/2766] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:41.497617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:41.499213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:41.514296 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe7d8-d350-4aa2-8283-5349e212766f service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:41.520887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7c2db-c8eb-4899-96ad-84a593f9ee17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:41.521542 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c2db-c8eb-4899-96ad-84a593f9ee17 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:41.521818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c2db-c8eb-4899-96ad-84a593f9ee17 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:41.522089 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7c2db-c8eb-4899-96ad-84a593f9ee17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:41.531259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7c2db-c8eb-4899-96ad-84a593f9ee17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:41.532873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7c2db-c8eb-4899-96ad-84a593f9ee17 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:41.542509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1400/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:42.349728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:42.364930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dfba1-fcdd-4278-ae5b-2f82b82c6fbf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:42.371119 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:42.371897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:42.372183 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:42.372452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:42.374404 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:42.385668 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:42.387304 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:42.396944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1368/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:51.538335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=37 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:51.942716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715e55-329d-4e98-8026-359800f28a71 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:51.942953 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715e55-329d-4e98-8026-359800f28a71 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:51.943287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715e55-329d-4e98-8026-359800f28a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:51.963127 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b715e55-329d-4e98-8026-359800f28a71 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:51.964327 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b715e55-329d-4e98-8026-359800f28a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:51.973230 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1401/2769] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:51.995142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:52.007338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df5d62-d00c-4731-ac89-0ab249b5ce1a service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:52.014913 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:52.015608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:52.015890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:52.016154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:52.032958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:52.032958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:52.039807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1369/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:55.050899 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9d81-6e14-4dcc-92bf-0d50e470f481 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:55.051429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9d81-6e14-4dcc-92bf-0d50e470f481 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:55.051516 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9d81-6e14-4dcc-92bf-0d50e470f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:55.070001 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ed0f9d81-6e14-4dcc-92bf-0d50e470f481 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:55.071255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ed0f9d81-6e14-4dcc-92bf-0d50e470f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:55.079696 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1402/2771] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:49:55.101078 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:55.112785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca4a53-5da7-4fd1-9f76-d852bc2aaacd service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:55.119127 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:55.119873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:55.120216 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:55.120556 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:55.130281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:55.131988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:55.143085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1370/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:49:59.259556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd639-07a5-49e2-8aa1-8a121657420e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:59.260090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd639-07a5-49e2-8aa1-8a121657420e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:59.260090 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd639-07a5-49e2-8aa1-8a121657420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:59.280192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e27cd639-07a5-49e2-8aa1-8a121657420e None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:49:59.281438 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e27cd639-07a5-49e2-8aa1-8a121657420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:49:59.290889 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1403/2773] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:49:59.316779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:49:59.332691 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00f15-7488-485c-addf-603fd17843d3 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:49:59.339387 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:49:59.340040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:49:59.340329 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:49:59.340600 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:49:59.350965 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:49:59.355245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:49:59.369601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1371/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:02.438174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26006-08e9-44ba-8b37-b134d3be1c17 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:02.438713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26006-08e9-44ba-8b37-b134d3be1c17 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:02.438713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26006-08e9-44ba-8b37-b134d3be1c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:02.458336 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-75a26006-08e9-44ba-8b37-b134d3be1c17 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:02.459617 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-75a26006-08e9-44ba-8b37-b134d3be1c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:02.469844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1404/2775] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:02.491958 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:02.505306 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e7415-64e0-44f8-ab3b-365a09be4d91 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:02.514249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:02.514249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:02.514249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:02.514249 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:02.522807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:02.524434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:02.534815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1372/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:12.452116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=12 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:12.530328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=60 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:17.720390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3e51d-1fcb-4eb0-b2ac-5cfd58a2a8e0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:17.720923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3e51d-1fcb-4eb0-b2ac-5cfd58a2a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:17.720923 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3e51d-1fcb-4eb0-b2ac-5cfd58a2a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:17.740757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0be3e51d-1fcb-4eb0-b2ac-5cfd58a2a8e0 None None] MFA Rules not processed for user `82481f9693ca4071846774faed1d2af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:17.741973 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0be3e51d-1fcb-4eb0-b2ac-5cfd58a2a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:17.797755 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1405/2777] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:50:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:18.047863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:18.049879 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:18.111576 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bd355-b0a4-4048-b8dd-57a36cfccd60 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:18.115522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:18.116161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:18.116439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:18.116706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:18.118755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:18.128930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:18.130396 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:18.138778 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1373/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:27.790370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=25 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:28.135064 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=26 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:31.947140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a0b14-8043-4554-8531-67e71a618f08 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:31.947697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a0b14-8043-4554-8531-67e71a618f08 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:31.947697 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a0b14-8043-4554-8531-67e71a618f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:31.973346 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ac2a0b14-8043-4554-8531-67e71a618f08 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:31.974710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac2a0b14-8043-4554-8531-67e71a618f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:31.984636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1406/2779] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:32.007395 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:32.022161 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7857-d8ab-4ce0-8b2e-dd19ad145f42 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:32.032924 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:32.033572 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:32.033860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:32.034120 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:32.043939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:32.045527 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:32.055948 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1374/2780] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:35.225125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f68bb-b00f-42ef-abbe-fd632b14a55f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:35.225759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f68bb-b00f-42ef-abbe-fd632b14a55f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:35.225759 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f68bb-b00f-42ef-abbe-fd632b14a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:35.247027 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-654f68bb-b00f-42ef-abbe-fd632b14a55f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:35.248416 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-654f68bb-b00f-42ef-abbe-fd632b14a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:35.258977 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1407/2781] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:35.280243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:35.295564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234bd6e-0eb4-47d7-abcb-d93753a1c9b4 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:35.301779 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:35.302452 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:35.302714 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:35.303018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:35.312615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:35.314622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:35.324765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1375/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:38.318409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f9bc-ba21-4a48-9e53-0992c494b2cf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:38.319117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f9bc-ba21-4a48-9e53-0992c494b2cf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:38.319117 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f9bc-ba21-4a48-9e53-0992c494b2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:38.343869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9c15f9bc-ba21-4a48-9e53-0992c494b2cf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:38.345102 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c15f9bc-ba21-4a48-9e53-0992c494b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:38.354912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1408/2783] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:38.377742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:38.389872 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76335f-aafe-45c0-82e0-134e8d4a914f service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:38.396825 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:38.397470 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:38.397755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:38.398026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:38.407273 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:38.408859 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:38.418708 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1376/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:41.520443 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bfaa7-5386-4c88-8951-00a9ede1e7df None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:41.520988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bfaa7-5386-4c88-8951-00a9ede1e7df None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:41.520988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bfaa7-5386-4c88-8951-00a9ede1e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:41.542540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-547bfaa7-5386-4c88-8951-00a9ede1e7df None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:41.543798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-547bfaa7-5386-4c88-8951-00a9ede1e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:41.552751 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1409/2785] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:41.574928 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:41.588328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fa2f8-a306-422b-98e8-3cc595bc651f service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:41.596271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:41.596919 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:41.597226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:41.597625 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:41.608932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:41.610545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:41.621679 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1377/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:45.743249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:45.743787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:45.743787 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:45.763322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:50:45.764584 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:50:45.773924 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1410/2787] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 22:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:50:45.796776 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:50:45.809488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000349b-54f3-4938-ae08-baa0a47257e7 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:50:45.815564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1ef9948ee7a4b2b86b823b7e97a7d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:50:45.816207 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:50:45.816488 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:50:45.816756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:50:45.825598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:50:45.827235 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:50:45.837291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1378/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:50:55.757919 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=15 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:55.833465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=30 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:19.263572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:19.265225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:19.327814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:19.330790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:19.347987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7ce8-597b-4acc-b6bc-71d0efbdb3f1 service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:19.354648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:19.355608 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.355892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.356166 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] PATH_INFO: `/v3/users/82481f9693ca4071846774faed1d2af0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.357518 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82481f9693ca4071846774faed1d2af0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:19.359523 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:19.359754 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e21d0-a59c-4f76-aec5-ec2971ee2fa2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:19.364939 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:19.365581 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.365979 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.366283 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.368161 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:19.381145 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:19.382774 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:19.394096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1411/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:19.424285 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82481f9693ca4071846774faed1d2af0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.431901 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82481f9693ca4071846774faed1d2af0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.432507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82481f9693ca4071846774faed1d2af0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.439601 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82481f9693ca4071846774faed1d2af0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.451500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-c86ad22d-d38f-4b53-b0d3-19136d558a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82481f9693ca4071846774faed1d2af0'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.457345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1379/2790] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:19 2022] DELETE /identity/v3/users/82481f9693ca4071846774faed1d2af0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:19.637274 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:19.648557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b67b7-8ab0-4e3d-aa90-65a44bca229d service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:19.715276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:19.716159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.716448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.716724 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] PATH_INFO: `/v3/projects/3f081b7689254dbc9924920c9b197333` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.717907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f081b7689254dbc9924920c9b197333)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:19.719878 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:19.770936 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f081b7689254dbc9924920c9b197333', 'request_id': 'req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.779738 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f081b7689254dbc9924920c9b197333', 'request_id': 'req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.785918 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f081b7689254dbc9924920c9b197333', 'request_id': 'req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.797378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] The token cache is being invalidate because project 3f081b7689254dbc9924920c9b197333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:19.797663 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.798301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1f88fba7-12fc-41d4-a2c2-b81384ae83a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:19.799887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1412/2791] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:19 2022] DELETE /identity/v3/projects/3f081b7689254dbc9924920c9b197333 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:19.805104 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.805391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.805664 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.823925 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:19.825131 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:19.887685 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1380/2792] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:19.895379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.895666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.895951 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.914563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:19.915804 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:19.923747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1413/2793] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:19.928038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:19.937690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c74a2-eb08-400d-aa56-64fc1a36d9cf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:19.942323 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:19.942966 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.943293 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.943565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.944290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:51:19.944941 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:19.946225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:19.959200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1381/2794] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:51:19.963871 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:19.973986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56bb4d-f748-4316-bb2f-50c292ae565d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:19.979858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:19.980798 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:19.981159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:19.981415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:19.982491 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:19.985341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:19.998007 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:20.030544 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1414/2795] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:51:19 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:20.035168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:20.049932 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cc4ea-74eb-4726-8b56-1cfc0ea8aea1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:20.121751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:20.122807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:20.123265 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:20.123687 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:20.124804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:20.127903 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:20.136710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:20.156035 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1382/2796] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:51:20 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:51:20.159876 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:20.171270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7c27-fda9-406a-93b9-7b219bc7eaa0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:20.177364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:20.178435 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:20.178851 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:20.179312 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:20.180415 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:20.183021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:20.198255 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1415/2797] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:20.202440 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:20.214032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b13f2-4246-4409-a47d-9527c20ae75d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:20.219710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c32dc-349d-49ec-99b6-f88fd2d8961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:20.220320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c32dc-349d-49ec-99b6-f88fd2d8961b admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:20.220596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c32dc-349d-49ec-99b6-f88fd2d8961b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:20.220864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c32dc-349d-49ec-99b6-f88fd2d8961b admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:20.221586 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c32dc-349d-49ec-99b6-f88fd2d8961b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:20.223225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c32dc-349d-49ec-99b6-f88fd2d8961b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:20.233939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1383/2798] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:20.238297 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:20.249601 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe2c18-a1ef-44c6-9532-0defd46a050f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:20.255731 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:20.256626 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:20.256869 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:20.257164 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] PATH_INFO: `/v3/projects/943bbfbe7d2a4655ac941acc0cff38d2/users/1f35ae29e47d414e8e005a8db053af84/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:20.272459 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943bbfbe7d2a4655ac941acc0cff38d2, user_id=1f35ae29e47d414e8e005a8db053af84, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:20.275192 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:20.291773 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1416/2799] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:20 2022] PUT /identity/v3/projects/943bbfbe7d2a4655ac941acc0cff38d2/users/1f35ae29e47d414e8e005a8db053af84/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:20.301940 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:20.302227 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:20.302501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:20.330234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] MFA Rules not processed for user `1f35ae29e47d414e8e005a8db053af84`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:20.331513 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:20.401745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1384/2800] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:20.413205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:20.415362 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:20.481004 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce94a-8c12-43c3-945f-9f27f94f0007 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:20.485451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:20.486103 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:20.486386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:20.486668 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:20.496025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:20.497484 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:20.510079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1417/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:29.452175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:29.453584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:29.519698 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2f0f-f704-4997-a6c5-dfb2a1e77b8b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:29.523933 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:29.524615 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:29.524893 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:29.525160 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:29.527336 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:29.603085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:29.604598 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2c0d0-8e49-43b4-b8d7-5272f3c8280a service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:29.616200 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1385/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:30.502832 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:30.679846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:30.691472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128a62-bec1-45d7-9177-0799dc3e6d59 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:30.696481 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:30.698398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:30.698398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:30.698398 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] PATH_INFO: `/v3/users/1f35ae29e47d414e8e005a8db053af84` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:30.699537 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f35ae29e47d414e8e005a8db053af84)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:30.702311 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:30.756717 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f35ae29e47d414e8e005a8db053af84'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:30.766083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f35ae29e47d414e8e005a8db053af84'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:30.767044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f35ae29e47d414e8e005a8db053af84'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:30.775232 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f35ae29e47d414e8e005a8db053af84'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:30.776022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f35ae29e47d414e8e005a8db053af84'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:30.795693 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1418/2803] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:30 2022] DELETE /identity/v3/users/1f35ae29e47d414e8e005a8db053af84 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:30.800540 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:30.801403 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:30.801628 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:30.821457 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:30.822755 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:30.836775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:30.893091 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1386/2804] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:51:30.903130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:30.905096 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:30.965640 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91096287-3576-4124-bf5f-552da30b2654 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:30.969636 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:30.970277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:30.970566 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:30.970866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:30.981409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:30.982881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:30.993673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1419/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:31.350303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:31.352086 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:31.364730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deac1e1-5ae8-4eee-a587-f02cefa43fab None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:31.379058 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:31.380762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:31.380762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:31.380762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] PATH_INFO: `/v3/projects/943bbfbe7d2a4655ac941acc0cff38d2` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:31.382039 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=943bbfbe7d2a4655ac941acc0cff38d2)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:31.384136 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:31.435777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943bbfbe7d2a4655ac941acc0cff38d2', 'request_id': 'req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:31.442564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943bbfbe7d2a4655ac941acc0cff38d2', 'request_id': 'req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:31.454961 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943bbfbe7d2a4655ac941acc0cff38d2', 'request_id': 'req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:31.471729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] The token cache is being invalidate because project 943bbfbe7d2a4655ac941acc0cff38d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:31.471729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:31.472640 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:31.474801 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1387/2806] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:31 2022] DELETE /identity/v3/projects/943bbfbe7d2a4655ac941acc0cff38d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:32.937196 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:32.938716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:32.955425 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036bd2-9281-4d36-b51c-467d96db85c2 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.014673 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.015603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.015884 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.016156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] PATH_INFO: `/v3/users/c9eeca4826c344c5bb62eec21ccba6f5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.017389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9eeca4826c344c5bb62eec21ccba6f5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.019365 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.037631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:33.072553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9eeca4826c344c5bb62eec21ccba6f5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.080744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9eeca4826c344c5bb62eec21ccba6f5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.081503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9eeca4826c344c5bb62eec21ccba6f5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.092988 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9eeca4826c344c5bb62eec21ccba6f5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.094080 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-651f5b0a-a606-422b-a07f-aec24e4213e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9eeca4826c344c5bb62eec21ccba6f5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.117169 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1420/2807] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:32 2022] DELETE /identity/v3/users/c9eeca4826c344c5bb62eec21ccba6f5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:33.304030 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.306150 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:33.332205 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ffd5b-fa5e-4d3e-b8e2-9a65f9ed72ed admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.395365 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.396268 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.396544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.396811 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] PATH_INFO: `/v3/projects/fd304e10901a4579939ab5f57171eae0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.398060 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd304e10901a4579939ab5f57171eae0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.400024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.446121 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:33.450684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd304e10901a4579939ab5f57171eae0', 'request_id': 'req-06c58398-3905-4198-a69d-30e5024a3722'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.459138 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd304e10901a4579939ab5f57171eae0', 'request_id': 'req-06c58398-3905-4198-a69d-30e5024a3722'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.471814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd304e10901a4579939ab5f57171eae0', 'request_id': 'req-06c58398-3905-4198-a69d-30e5024a3722'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.483867 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] The token cache is being invalidate because project fd304e10901a4579939ab5f57171eae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:33.484154 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.484815 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-06c58398-3905-4198-a69d-30e5024a3722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:33.486391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1388/2808] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:33 2022] DELETE /identity/v3/projects/fd304e10901a4579939ab5f57171eae0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:33.491700 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.491986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.492257 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.511340 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:33.512586 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:33.571618 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1421/2809] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:33.581085 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.581486 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.581845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.614309 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:33.616294 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:33.630730 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1389/2810] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:33.635091 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.645259 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d55ce-22ba-4941-831e-7801ce6bcaa7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.651030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.651706 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.651982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.652249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.652974 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:51:33.653276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.655287 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.667508 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1422/2811] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:51:33.672744 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.684980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95bf9a-2fa4-4674-8423-d462911edd23 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.690767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.691469 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.691745 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.692011 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.692699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.694607 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.722878 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1390/2812] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:51:33 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:33.727113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.737163 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7337d8-b771-4956-90b0-ff9994fd9090 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.794130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.794795 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.795108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.795382 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.796065 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.797989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.820194 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1423/2813] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:51:33 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:33.825172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.839246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07c42c-c5eb-4de8-9edf-b181658f1773 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.844512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.845181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.845459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.845729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.846483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.848106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.859286 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1391/2814] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:33.863500 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.874143 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0117-4921-409d-8005-e5da149c7c49 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.879992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730e26-430c-4039-a4b1-367d95ab7256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.880733 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730e26-430c-4039-a4b1-367d95ab7256 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.881009 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730e26-430c-4039-a4b1-367d95ab7256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.881276 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730e26-430c-4039-a4b1-367d95ab7256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.882010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e730e26-430c-4039-a4b1-367d95ab7256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.883676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e730e26-430c-4039-a4b1-367d95ab7256 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.889356 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:33.896305 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1424/2815] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:33.900020 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:33.911592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace9c8-401e-47ce-b4ff-6ec09e6a2dc7 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:33.916448 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:33.917340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.917623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.917892 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] PATH_INFO: `/v3/projects/fe043e6abc2b4670af90eb79680e4cc1/users/a4961f765626486a8f843e1501c6ba9f/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.934054 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe043e6abc2b4670af90eb79680e4cc1, user_id=a4961f765626486a8f843e1501c6ba9f, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:33.936756 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:33.951172 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1392/2816] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:33 2022] PUT /identity/v3/projects/fe043e6abc2b4670af90eb79680e4cc1/users/a4961f765626486a8f843e1501c6ba9f/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:33.961573 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:33.962104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:33.962104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:33.989485 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] MFA Rules not processed for user `a4961f765626486a8f843e1501c6ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:33.990608 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:34.067099 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1425/2817] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:34.071843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.135886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37456fc-6968-44e4-8780-92afdabae707 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.141418 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.142189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.142477 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.142721 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.143481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.145449 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.175067 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1393/2818] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:51:34 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:34.179406 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.190353 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b1952-9ec7-4c2c-8be6-c053bbb72270 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.249852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.250448 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.250727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.251010 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.251734 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.253661 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.279354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1426/2819] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:51:34 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:34.285545 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.297263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50247f9-30c2-4b3e-91bd-32eb4e00a4ed admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.303716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.304384 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.304976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.304976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.305635 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.307380 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.318980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1394/2820] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:34.324111 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.339561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b97fe-dc24-4e03-b74f-7a993cda1f82 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.348026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.349562 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.349940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.350288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] PATH_INFO: `/v3/projects/6977404331b74c049291b699178089b2/users/aab04bae2aa1450b8e9e3652cd1f1c78/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.367872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6977404331b74c049291b699178089b2, user_id=aab04bae2aa1450b8e9e3652cd1f1c78, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.370609 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.386569 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1427/2821] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:34 2022] PUT /identity/v3/projects/6977404331b74c049291b699178089b2/users/aab04bae2aa1450b8e9e3652cd1f1c78/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:34.390656 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.401471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de2340-62b3-4e81-8ca5-66af0680bc28 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.443318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:34.462548 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6981f-ef1e-422b-8336-41cc9a6db5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.463243 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6981f-ef1e-422b-8336-41cc9a6db5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.463522 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6981f-ef1e-422b-8336-41cc9a6db5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.463791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6981f-ef1e-422b-8336-41cc9a6db5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.464514 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6981f-ef1e-422b-8336-41cc9a6db5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.466167 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6981f-ef1e-422b-8336-41cc9a6db5f4 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.476368 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1395/2822] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:34.480713 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.491376 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a102be6-014c-45e8-a815-766c97d7a347 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.496782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.497678 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.497955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.498225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] PATH_INFO: `/v3/projects/6977404331b74c049291b699178089b2/users/aab04bae2aa1450b8e9e3652cd1f1c78/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.500472 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6977404331b74c049291b699178089b2, user_id=aab04bae2aa1450b8e9e3652cd1f1c78, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.503135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.514480 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1428/2823] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:34 2022] PUT /identity/v3/projects/6977404331b74c049291b699178089b2/users/aab04bae2aa1450b8e9e3652cd1f1c78/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:34.530593 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.530942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.531362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.563307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] MFA Rules not processed for user `aab04bae2aa1450b8e9e3652cd1f1c78`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:34.564531 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:34.636592 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1396/2824] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:34.649881 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:34.651870 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:34.699813 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:34.714378 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49ed1-7809-41c2-b10d-deec4077ccc5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:34.718284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559594f-e297-4b71-9457-cb2e7a71fb3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:34.718959 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559594f-e297-4b71-9457-cb2e7a71fb3c service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:34.719268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559594f-e297-4b71-9457-cb2e7a71fb3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:34.719540 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559594f-e297-4b71-9457-cb2e7a71fb3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:34.728812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559594f-e297-4b71-9457-cb2e7a71fb3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:34.730303 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559594f-e297-4b71-9457-cb2e7a71fb3c service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:34.739570 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1429/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:35.149804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:35.216569 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3ba1-c8ae-41d2-929b-87df8df6b693 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:35.221975 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:35.222865 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:35.223178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:35.223450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] PATH_INFO: `/v3/users/a4961f765626486a8f843e1501c6ba9f` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:35.224742 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4961f765626486a8f843e1501c6ba9f)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:35.226701 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:35.285996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4961f765626486a8f843e1501c6ba9f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.296110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4961f765626486a8f843e1501c6ba9f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.296871 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4961f765626486a8f843e1501c6ba9f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.309028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4961f765626486a8f843e1501c6ba9f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.311287 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:35.324791 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4961f765626486a8f843e1501c6ba9f'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.332025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1397/2826] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:35 2022] DELETE /identity/v3/users/a4961f765626486a8f843e1501c6ba9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:35.336571 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:35.337074 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:35.337172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:35.355245 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:35.356456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:35.419750 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1430/2827] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:35.433347 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:35.434905 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:35.496637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad487e3-9f74-4224-8845-cd13d326b673 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:35.500754 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:35.501398 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:35.501677 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:35.501944 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:35.512749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:35.514215 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:35.525018 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1398/2828] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:35.801389 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:35.803862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:35.816449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02299-f515-4751-abf3-750874adb5a7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:35.821555 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:35.822450 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:35.822727 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:35.823113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] PATH_INFO: `/v3/projects/fe043e6abc2b4670af90eb79680e4cc1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:35.824393 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe043e6abc2b4670af90eb79680e4cc1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:35.826348 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:35.872602 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe043e6abc2b4670af90eb79680e4cc1', 'request_id': 'req-0770979e-ae09-4a66-b1db-f183445e0596'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.880912 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe043e6abc2b4670af90eb79680e4cc1', 'request_id': 'req-0770979e-ae09-4a66-b1db-f183445e0596'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.886379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe043e6abc2b4670af90eb79680e4cc1', 'request_id': 'req-0770979e-ae09-4a66-b1db-f183445e0596'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.897391 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] The token cache is being invalidate because project fe043e6abc2b4670af90eb79680e4cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:35.897671 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.898294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:35.899854 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1431/2829] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:35 2022] DELETE /identity/v3/projects/fe043e6abc2b4670af90eb79680e4cc1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:35.904471 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:35.914922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eaada-1195-4334-b912-6fd8e07888cf service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:35.975788 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:35.976682 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:35.976954 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:35.977223 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] PATH_INFO: `/v3/users/aab04bae2aa1450b8e9e3652cd1f1c78` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:35.978544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab04bae2aa1450b8e9e3652cd1f1c78)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:35.980655 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.035113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab04bae2aa1450b8e9e3652cd1f1c78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.045083 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab04bae2aa1450b8e9e3652cd1f1c78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.045760 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab04bae2aa1450b8e9e3652cd1f1c78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.053038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab04bae2aa1450b8e9e3652cd1f1c78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.065507 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7e08ee5d-c68f-4799-aeaf-d5d532613c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab04bae2aa1450b8e9e3652cd1f1c78'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.072181 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1399/2830] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:35 2022] DELETE /identity/v3/users/aab04bae2aa1450b8e9e3652cd1f1c78 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:36.361134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.362644 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:36.378456 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770979e-ae09-4a66-b1db-f183445e0596 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.440576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.441392 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.441670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.441940 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] PATH_INFO: `/v3/projects/6977404331b74c049291b699178089b2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.444072 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6977404331b74c049291b699178089b2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.446236 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.458646 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:36.497550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6977404331b74c049291b699178089b2', 'request_id': 'req-d5914cee-cbe4-4946-883c-04e990bcb07d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.505647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6977404331b74c049291b699178089b2', 'request_id': 'req-d5914cee-cbe4-4946-883c-04e990bcb07d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.511326 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6977404331b74c049291b699178089b2', 'request_id': 'req-d5914cee-cbe4-4946-883c-04e990bcb07d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.522221 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] The token cache is being invalidate because project 6977404331b74c049291b699178089b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:36.522507 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.523172 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d5914cee-cbe4-4946-883c-04e990bcb07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:36.524761 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1432/2831] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:36 2022] DELETE /identity/v3/projects/6977404331b74c049291b699178089b2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:36.530654 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.531143 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.531237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.539206 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:36.556631 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:36.559015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:36.630189 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1400/2832] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:36.642682 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.643075 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.643338 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.671177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:36.672451 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:36.682130 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1433/2833] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:36.686706 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.697123 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dc773-6a79-4ab5-9e7c-ff46506a57bf None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.702793 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.703485 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.703800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.704028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.704785 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:51:36.705088 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.706699 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.719364 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1401/2834] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:51:36.723845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.733519 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff91753-4019-4f4c-8b18-4c6a9c0e4f3f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.739476 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.740154 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.740437 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.740707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.741419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.743369 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.773301 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1434/2835] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:51:36 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:51:36.778515 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.793938 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ccc5-fc9b-455a-9c42-5c06e7266e77 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.866081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.866767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.867076 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.867353 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.868049 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.870005 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.891559 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1402/2836] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:51:36 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:51:36.896045 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.907553 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca99e0-0a16-4d54-987e-0174688cb939 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.913124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.913833 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.914116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.914387 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.915225 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.916843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.927688 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1435/2837] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:36.932141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.942676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d8213-bc47-4b68-a72f-4c0f772e108f admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.948033 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1521ea-d05e-433f-91ac-0ef0a1dc88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.948637 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1521ea-d05e-433f-91ac-0ef0a1dc88b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.948915 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1521ea-d05e-433f-91ac-0ef0a1dc88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.949187 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1521ea-d05e-433f-91ac-0ef0a1dc88b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.949908 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1521ea-d05e-433f-91ac-0ef0a1dc88b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.951555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1521ea-d05e-433f-91ac-0ef0a1dc88b6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:36.961665 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1403/2838] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:36.965872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:36.975849 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d6da-ec53-4701-86f5-6178e0359c79 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:36.980685 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:36.981572 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:36.981844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:36.982113 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] PATH_INFO: `/v3/projects/2c9d2af9f9fe4537874ebecf9d17f031/users/0a7a1adb8ca14cc99eae3122ed4c6caf/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:36.996809 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9d2af9f9fe4537874ebecf9d17f031, user_id=0a7a1adb8ca14cc99eae3122ed4c6caf, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:36.999504 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.013576 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1436/2839] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:36 2022] PUT /identity/v3/projects/2c9d2af9f9fe4537874ebecf9d17f031/users/0a7a1adb8ca14cc99eae3122ed4c6caf/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:37.023888 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.024174 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.024445 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.052152 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] MFA Rules not processed for user `0a7a1adb8ca14cc99eae3122ed4c6caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:37.053361 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:37.121840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:37.126144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1404/2840] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:37.131579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.197674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafa58-2bb4-4a4a-aa89-3c0841167754 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.203770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.204367 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.204651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.204955 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.205679 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.207672 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.234957 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1437/2841] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:51:37 2022] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:37.239340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.250752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e86f4-8e4f-40ae-aed8-38d60b4921ac None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.319585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.320431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.320792 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.321026 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.321794 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.323953 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.346412 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1405/2842] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:51:37 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:37.350667 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.362115 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb5d4-1ba7-4151-8984-d942822e63ff admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.367386 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.368050 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.368317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.368578 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.369306 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.371030 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.382222 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1438/2843] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:37.386431 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.396909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4084f-a8d6-4d10-bdf7-f553f0dd7b29 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.401752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.402650 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.402930 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.403234 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] PATH_INFO: `/v3/projects/374f38bc3b934a2197c10427fbea3fdc/users/92acee83eda8416aa98af7387650866e/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.418300 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f38bc3b934a2197c10427fbea3fdc, user_id=92acee83eda8416aa98af7387650866e, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.421013 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.436203 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1406/2844] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:37 2022] PUT /identity/v3/projects/374f38bc3b934a2197c10427fbea3fdc/users/92acee83eda8416aa98af7387650866e/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:37.440159 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.450941 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5259-b202-4b82-ae31-ed6ec13d5f6d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.456295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:37.509025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f6f08-fc62-4c82-ab10-b765cfda1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.509702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6f08-fc62-4c82-ab10-b765cfda1342 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.509990 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6f08-fc62-4c82-ab10-b765cfda1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.510261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6f08-fc62-4c82-ab10-b765cfda1342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.511025 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f6f08-fc62-4c82-ab10-b765cfda1342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.512768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f6f08-fc62-4c82-ab10-b765cfda1342 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.522972 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1439/2845] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:37.527491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.539226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1090-30c9-4f3d-93b0-06b126a3f502 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.544897 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.545840 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.546118 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.546390 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] PATH_INFO: `/v3/projects/374f38bc3b934a2197c10427fbea3fdc/users/92acee83eda8416aa98af7387650866e/roles/66993d8e036c40d2809b9b7230ec4195` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.548500 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f38bc3b934a2197c10427fbea3fdc, user_id=92acee83eda8416aa98af7387650866e, role_id=66993d8e036c40d2809b9b7230ec4195)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.551233 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.563439 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1407/2846] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:37 2022] PUT /identity/v3/projects/374f38bc3b934a2197c10427fbea3fdc/users/92acee83eda8416aa98af7387650866e/roles/66993d8e036c40d2809b9b7230ec4195 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:37.573926 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.574212 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.574483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.602298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] MFA Rules not processed for user `92acee83eda8416aa98af7387650866e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:37.603557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:37.673024 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1440/2847] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:37 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:37.689647 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.691728 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:37.753916 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f8c58-f22b-4da3-96e1-218235904c8e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.758171 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.758813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.759125 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.759405 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.768873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.770318 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.780352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1408/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:37 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:37.855846 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:37.866295 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb28ff-314c-471e-ab2b-edf2071ff6bf None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:37.871108 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb287148-3cbf-465a-b84b-a6cae2c3417b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:37.871757 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb287148-3cbf-465a-b84b-a6cae2c3417b service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:37.872041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb287148-3cbf-465a-b84b-a6cae2c3417b service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:37.872315 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb287148-3cbf-465a-b84b-a6cae2c3417b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:37.936946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb287148-3cbf-465a-b84b-a6cae2c3417b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:37.938374 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb287148-3cbf-465a-b84b-a6cae2c3417b service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:37.947982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1441/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:45.104156 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:45.171839 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:45.178856 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3a266-7e1b-41ac-a996-4e5c36d1dddd service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:45.183506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:45.184420 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:45.184693 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:45.184957 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] PATH_INFO: `/v3/users/0a7a1adb8ca14cc99eae3122ed4c6caf` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:45.186245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7a1adb8ca14cc99eae3122ed4c6caf)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:45.188201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:45.239695 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7a1adb8ca14cc99eae3122ed4c6caf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.249690 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7a1adb8ca14cc99eae3122ed4c6caf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.250375 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7a1adb8ca14cc99eae3122ed4c6caf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.262082 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7a1adb8ca14cc99eae3122ed4c6caf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.276178 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7a1adb8ca14cc99eae3122ed4c6caf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.283423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1409/2850] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:45 2022] DELETE /identity/v3/users/0a7a1adb8ca14cc99eae3122ed4c6caf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:45.288986 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:45.289579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:45.289579 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:45.311067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:45.312329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:45.340079 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:45.377177 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1442/2851] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:45.383684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:45.385366 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:45.449622 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96185fdb-4f3d-4221-b62e-7ae81534c37b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:45.454022 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:45.454684 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:45.454968 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:45.455280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:45.465939 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:45.467505 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:45.477724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1410/2852] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:51:45.769677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:45.771271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:45.784533 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e18a8e-1313-47ff-b931-4e0551a3a111 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:45.790298 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:45.791213 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:45.791509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:45.791778 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] PATH_INFO: `/v3/projects/2c9d2af9f9fe4537874ebecf9d17f031` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:45.793119 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9d2af9f9fe4537874ebecf9d17f031)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:45.795141 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:45.847739 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9d2af9f9fe4537874ebecf9d17f031', 'request_id': 'req-832afb88-a8c4-4cbf-8bf0-b707921c943e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.856875 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9d2af9f9fe4537874ebecf9d17f031', 'request_id': 'req-832afb88-a8c4-4cbf-8bf0-b707921c943e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.862712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9d2af9f9fe4537874ebecf9d17f031', 'request_id': 'req-832afb88-a8c4-4cbf-8bf0-b707921c943e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.874464 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] The token cache is being invalidate because project 2c9d2af9f9fe4537874ebecf9d17f031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:45.874863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.875556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:45.877144 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1443/2853] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:45 2022] DELETE /identity/v3/projects/2c9d2af9f9fe4537874ebecf9d17f031 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:45.881352 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:45.892037 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f76391-89c9-4e61-89c0-0b07c0324fd9 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:45.952164 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:45.953047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:45.953356 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:45.953626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] PATH_INFO: `/v3/users/92acee83eda8416aa98af7387650866e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:45.954873 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92acee83eda8416aa98af7387650866e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:45.957191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:45.978870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:46.010010 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92acee83eda8416aa98af7387650866e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.021988 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92acee83eda8416aa98af7387650866e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.022692 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92acee83eda8416aa98af7387650866e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.031141 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92acee83eda8416aa98af7387650866e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.043922 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a0d973eb-0e74-4b8c-828f-e836a6315491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92acee83eda8416aa98af7387650866e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.050201 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1411/2854] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:51:45 2022] DELETE /identity/v3/users/92acee83eda8416aa98af7387650866e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:46.334175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.335723 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:46.349341 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832afb88-a8c4-4cbf-8bf0-b707921c943e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.422782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.423683 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.423978 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.424249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] PATH_INFO: `/v3/projects/374f38bc3b934a2197c10427fbea3fdc` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.425489 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=374f38bc3b934a2197c10427fbea3fdc)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.427431 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.476432 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374f38bc3b934a2197c10427fbea3fdc', 'request_id': 'req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.479987 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:46.484548 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374f38bc3b934a2197c10427fbea3fdc', 'request_id': 'req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.491349 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374f38bc3b934a2197c10427fbea3fdc', 'request_id': 'req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.502860 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] The token cache is being invalidate because project 374f38bc3b934a2197c10427fbea3fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:51:46.503135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.503848 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eabdb605-5cff-4cc2-97d0-8b5b043a8c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:51:46.505503 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1444/2855] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:51:46 2022] DELETE /identity/v3/projects/374f38bc3b934a2197c10427fbea3fdc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:46.511800 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.512333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.512333 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.532402 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:46.533602 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:46.598245 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1412/2856] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:46.606521 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.606805 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.607118 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.627208 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:46.628429 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:46.637606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1445/2857] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:46.642101 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.651951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b42b-db8f-48d4-810c-b7fc9c7f270a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.657777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.658461 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.658733 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.659021 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.659762 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:51:46.660065 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.661670 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.673861 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1413/2858] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:51:46.678460 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.688788 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33d69-0ba5-48e0-af1d-dce43f2a1f30 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.694897 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.695580 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.695853 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.696128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.696815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.698712 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.731067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1446/2859] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:51:46 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:46.736976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.751071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08184911-73eb-41d8-8cb1-c219bd82800e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.811626 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.812238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.812524 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.813139 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.813831 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.815851 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.838341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1414/2860] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:51:46 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:51:46.843782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.854799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586a26-ee6a-43ed-85b4-27f789eef279 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.859726 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.860383 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.860677 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.860948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.861674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.863308 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.873857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1447/2861] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:46.877920 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.888510 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1ef63-9c30-40f6-b587-41487aba93b6 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.893774 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbbf6a-81e3-4c8c-a6d9-56f97b72fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.894450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbf6a-81e3-4c8c-a6d9-56f97b72fe05 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.894729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbf6a-81e3-4c8c-a6d9-56f97b72fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.895032 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbf6a-81e3-4c8c-a6d9-56f97b72fe05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.895758 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbbf6a-81e3-4c8c-a6d9-56f97b72fe05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.897377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbbf6a-81e3-4c8c-a6d9-56f97b72fe05 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.908567 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1415/2862] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:51:46.913104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:46.923603 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00aeca-07da-45fa-846d-c44bfba4c8ab admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:46.928836 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:46.929718 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.929991 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.930256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] PATH_INFO: `/v3/projects/90e66f31bf0642db8043722518d6c2fa/users/f4b40f47d890460690222380e2fb706e/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.945110 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e66f31bf0642db8043722518d6c2fa, user_id=f4b40f47d890460690222380e2fb706e, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:46.947811 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:46.965629 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1448/2863] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:51:46 2022] PUT /identity/v3/projects/90e66f31bf0642db8043722518d6c2fa/users/f4b40f47d890460690222380e2fb706e/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:51:46.976896 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:46.977175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:46.977481 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:46.985512 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:47.010209 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] MFA Rules not processed for user `f4b40f47d890460690222380e2fb706e`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:51:47.011472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:47.077562 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1416/2864] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:51:47.089170 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:51:47.090943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:51:47.183175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e7d71-cc2a-4292-80a0-e4eba34aeb13 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:51:47.188167 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebef307-be76-45cf-b6ad-81535b628ddb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b5e5657f0c243feaae1824559d6f816', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:51:47.188818 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef307-be76-45cf-b6ad-81535b628ddb service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:51:47.189100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef307-be76-45cf-b6ad-81535b628ddb service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:51:47.189373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebef307-be76-45cf-b6ad-81535b628ddb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:51:47.201768 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebef307-be76-45cf-b6ad-81535b628ddb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:51:47.203263 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebef307-be76-45cf-b6ad-81535b628ddb service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:51:47.212249 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1449/2865] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:51:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:51:57.074377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=31 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:57.208317 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=68,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:04.858483 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:04.926362 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8754ff-9f3e-4f5b-9e24-1801a71d8837 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:04.932110 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:04.932989 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:04.933263 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:04.933533 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] PATH_INFO: `/v3/users/f4b40f47d890460690222380e2fb706e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:04.934838 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b40f47d890460690222380e2fb706e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:04.936860 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:04.987051 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b40f47d890460690222380e2fb706e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:04.995337 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b40f47d890460690222380e2fb706e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:04.995980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b40f47d890460690222380e2fb706e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.002931 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b40f47d890460690222380e2fb706e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.014804 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b40f47d890460690222380e2fb706e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.020766 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1417/2866] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:52:04 2022] DELETE /identity/v3/users/f4b40f47d890460690222380e2fb706e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:52:05.025606 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.026134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.026134 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.045184 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:05.046445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:05.108005 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1450/2867] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:05.119702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:05.121487 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:05.185995 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849f243-fd6a-4f73-9b34-0e8985f22e30 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:05.189807 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7f2f-3611-4759-b688-1fa5150a2ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:05.190444 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7f2f-3611-4759-b688-1fa5150a2ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.190751 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7f2f-3611-4759-b688-1fa5150a2ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.191034 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7f2f-3611-4759-b688-1fa5150a2ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.200564 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7f2f-3611-4759-b688-1fa5150a2ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:05.201999 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7f2f-3611-4759-b688-1fa5150a2ea4 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:05.212196 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1418/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:52:05.506329 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:05.507890 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:05.520042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7305fb-1d70-4236-8c89-f576270d8ef4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:05.525910 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:05.526802 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.527109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.527556 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] PATH_INFO: `/v3/projects/90e66f31bf0642db8043722518d6c2fa` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.528852 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e66f31bf0642db8043722518d6c2fa)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:05.531594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:05.580624 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e66f31bf0642db8043722518d6c2fa', 'request_id': 'req-64c4e77e-a37a-43fa-bf78-e721ed731c08'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.589334 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e66f31bf0642db8043722518d6c2fa', 'request_id': 'req-64c4e77e-a37a-43fa-bf78-e721ed731c08'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.596097 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e66f31bf0642db8043722518d6c2fa', 'request_id': 'req-64c4e77e-a37a-43fa-bf78-e721ed731c08'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.607619 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] The token cache is being invalidate because project 90e66f31bf0642db8043722518d6c2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:52:05.607904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.608596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-64c4e77e-a37a-43fa-bf78-e721ed731c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:05.610136 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1451/2869] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:52:05 2022] DELETE /identity/v3/projects/90e66f31bf0642db8043722518d6c2fa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:52:05.615416 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.615705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.616024 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.634935 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:05.636184 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:05.654015 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:05.702463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1419/2870] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:05.774000 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.774241 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.774549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.795863 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:05.797155 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:05.807545 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1452/2871] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:05.813716 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:05.824648 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118d7a3-50d7-4c5b-8097-aa231a508209 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:05.831145 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:05.831806 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.832081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.832346 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.833072 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:52:05.833374 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:05.834978 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:05.849338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1420/2872] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:52:05.853715 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:05.863587 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b4f9-7481-4acc-8c98-e911786266ca None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:05.869070 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:05.869737 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.870044 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.870268 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.871026 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:05.872952 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:05.903702 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1453/2873] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:52:05 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:52:05.908399 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:05.922277 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6727-23b2-4193-81d8-2ae0c61b65ae admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:05.984055 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:05.984740 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:05.985019 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:05.985292 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:05.986016 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:05.987991 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.009423 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1421/2874] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:52:05 2022] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:52:06.013744 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:06.024975 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d8389-dfae-49f9-987c-8b4fea4d13d9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:06.030557 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:06.031237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.031536 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.031814 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.032561 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:06.034200 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.045427 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1454/2875] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:52:06.050023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:06.060775 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce05512-e36e-48df-8bf7-ab4b3c846329 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:06.066713 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be4c6-8ab8-428a-8a4d-8b96669a1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:06.067419 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be4c6-8ab8-428a-8a4d-8b96669a1ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.067729 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be4c6-8ab8-428a-8a4d-8b96669a1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.068003 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be4c6-8ab8-428a-8a4d-8b96669a1ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.068746 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5be4c6-8ab8-428a-8a4d-8b96669a1ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:06.070381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5be4c6-8ab8-428a-8a4d-8b96669a1ca2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.080846 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1422/2876] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:52:06.085550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:06.095932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a109d6b-3e8f-45b1-98f3-7068bd89c672 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:06.101483 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:06.102373 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.102651 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.102943 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] PATH_INFO: `/v3/projects/03e641bce97441588cc7cf51190e12bb/users/a6223674a8074f3a8a8fba1fa93b0c74/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.119966 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e641bce97441588cc7cf51190e12bb, user_id=a6223674a8074f3a8a8fba1fa93b0c74, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:06.122594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.141588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1455/2877] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:52:06 2022] PUT /identity/v3/projects/03e641bce97441588cc7cf51190e12bb/users/a6223674a8074f3a8a8fba1fa93b0c74/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:52:06.158472 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.158813 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.159226 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.193281 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] MFA Rules not processed for user `a6223674a8074f3a8a8fba1fa93b0c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:06.194719 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:06.263311 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1423/2878] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:06.298151 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:06.300252 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:06.324465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:06.364439 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebadf-6f73-47a9-b303-d2816f849a3c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:06.368934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81d23a-497a-4c94-b349-c5a166505fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:06.369674 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d23a-497a-4c94-b349-c5a166505fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.370104 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d23a-497a-4c94-b349-c5a166505fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.370316 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d23a-497a-4c94-b349-c5a166505fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.379550 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d23a-497a-4c94-b349-c5a166505fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:06.381002 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81d23a-497a-4c94-b349-c5a166505fc9 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.390146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1456/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:52:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:52:06.404142 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:06.424836 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:06.472561 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d6c9c-42c8-4a00-8b65-7061f05bfe5c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:06.477442 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:06.478302 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.478577 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.478843 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] PATH_INFO: `/v3/users/a6223674a8074f3a8a8fba1fa93b0c74` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.480113 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6223674a8074f3a8a8fba1fa93b0c74)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:06.482040 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.538135 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6223674a8074f3a8a8fba1fa93b0c74'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:06.548741 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6223674a8074f3a8a8fba1fa93b0c74'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:06.549649 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6223674a8074f3a8a8fba1fa93b0c74'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:06.560724 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6223674a8074f3a8a8fba1fa93b0c74'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:06.576963 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6223674a8074f3a8a8fba1fa93b0c74'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:06.583246 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1424/2880] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:52:06 2022] DELETE /identity/v3/users/a6223674a8074f3a8a8fba1fa93b0c74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:52:06.587894 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.588188 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.588462 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.606354 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:06.607615 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:06.673122 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1457/2881] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:06.684114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:06.685710 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:06.759148 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccc25-da77-4b7c-8599-dc44112fd27b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:06.763506 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2b77-6901-456c-a386-29e45c2a9593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:06.764191 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2b77-6901-456c-a386-29e45c2a9593 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:06.764495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2b77-6901-456c-a386-29e45c2a9593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:06.764761 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2b77-6901-456c-a386-29e45c2a9593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:06.775432 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2b77-6901-456c-a386-29e45c2a9593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:06.776864 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2b77-6901-456c-a386-29e45c2a9593 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:06.787996 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1425/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:52:07.076146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.077812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:07.090310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143a45-0658-4508-af1c-dff1adbfa10a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.096128 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.096989 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.097253 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.097527 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] PATH_INFO: `/v3/projects/03e641bce97441588cc7cf51190e12bb` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.098868 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e641bce97441588cc7cf51190e12bb)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.100822 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.154445 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e641bce97441588cc7cf51190e12bb', 'request_id': 'req-534837a0-7165-4766-8282-1c0e42169af9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:07.164364 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e641bce97441588cc7cf51190e12bb', 'request_id': 'req-534837a0-7165-4766-8282-1c0e42169af9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:07.170270 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e641bce97441588cc7cf51190e12bb', 'request_id': 'req-534837a0-7165-4766-8282-1c0e42169af9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:07.181829 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] The token cache is being invalidate because project 03e641bce97441588cc7cf51190e12bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:52:07.182055 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:07.182714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-534837a0-7165-4766-8282-1c0e42169af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:52:07.184282 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1458/2883] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:52:07 2022] DELETE /identity/v3/projects/03e641bce97441588cc7cf51190e12bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:52:07.190589 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.191114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.191114 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.211732 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:07.212936 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:07.249676 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:07.276976 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1426/2884] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:52:07.285490 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.285782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.286052 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.305496 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:07.306716 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:07.316220 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1459/2885] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:07.320777 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.332307 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340673-2073-4bb5-a862-b3fbb73b7ff0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.337492 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.338155 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.338434 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.338705 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.339463 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:52:07.339765 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.341377 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.354594 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1427/2886] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:52:07.359381 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.370067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce0c1-3acc-435c-8b5f-614fa4ce3d45 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.377083 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.377762 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.378046 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.378322 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.379036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.381231 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.416293 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1460/2887] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:52:07 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:52:07.422238 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.433319 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ccae-934c-4356-a1c6-8611fe6865e0 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.497291 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.497985 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.498269 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.498544 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.499280 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.501224 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.523317 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1428/2888] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:52:07 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:52:07.527707 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.539017 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce36169-92f5-4dd6-9799-90e4e9a7cf9b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.544185 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.544862 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.545146 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.545428 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.546174 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.547934 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.559411 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1461/2889] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:52:07.563764 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.574328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c16b1-5d2d-47a0-8ac0-91ff36e39bda admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.580426 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906b5b2-4898-4bbc-a512-88ee7b142136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.581271 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906b5b2-4898-4bbc-a512-88ee7b142136 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.581555 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906b5b2-4898-4bbc-a512-88ee7b142136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.581858 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906b5b2-4898-4bbc-a512-88ee7b142136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.582817 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906b5b2-4898-4bbc-a512-88ee7b142136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.584686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906b5b2-4898-4bbc-a512-88ee7b142136 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.596467 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1429/2890] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:52:07.601271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.611942 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd6e8f-ab11-4ade-bb8b-912e613ef4a0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.617129 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.618022 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.618289 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.618563 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] PATH_INFO: `/v3/projects/e5ef3c721f764770b9b91a3a0563ad48/users/42672230cde04b5ba726931731625a29/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.620904 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:07.636370 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ef3c721f764770b9b91a3a0563ad48, user_id=42672230cde04b5ba726931731625a29, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.639100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.653042 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1462/2891] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:52:07 2022] PUT /identity/v3/projects/e5ef3c721f764770b9b91a3a0563ad48/users/42672230cde04b5ba726931731625a29/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:52:07.658895 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0de1dd-9613-49da-9c78-3d5b80b03e0c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.659230 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0de1dd-9613-49da-9c78-3d5b80b03e0c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.659508 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0de1dd-9613-49da-9c78-3d5b80b03e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.677835 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-aa0de1dd-9613-49da-9c78-3d5b80b03e0c None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:07.679071 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aa0de1dd-9613-49da-9c78-3d5b80b03e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:07.743702 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1430/2892] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:07.755554 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:07.757310 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:07.819510 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf0614-83dc-494e-a7c4-c9e20e7e548e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:07.824175 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:07.824834 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:07.825109 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:07.825380 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:07.835845 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:07.837284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:07.847461 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1463/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:52:08.488814 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9179-1c52-4bf0-83da-91ff633a46e0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:08.489408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9179-1c52-4bf0-83da-91ff633a46e0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:08.489408 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9179-1c52-4bf0-83da-91ff633a46e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:08.519290 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-af3e9179-1c52-4bf0-83da-91ff633a46e0 None None] MFA Rules not processed for user `42672230cde04b5ba726931731625a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:08.520547 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-af3e9179-1c52-4bf0-83da-91ff633a46e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:08.559491 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:08.595962 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1431/2894] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:08.607409 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:08.608873 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:08.666186 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5054b-bdb8-4783-a0b6-868a9f9817f6 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:08.669982 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:08.670655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:08.670954 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:08.671256 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:08.680588 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:08.682041 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:08.691742 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1464/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:52:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:52:10.056987 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b107-e387-42af-b58b-43bde9912166 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:10.058458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b107-e387-42af-b58b-43bde9912166 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:10.058458 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b107-e387-42af-b58b-43bde9912166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:10.076168 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3b31b107-e387-42af-b58b-43bde9912166 None None] MFA Rules not processed for user `42672230cde04b5ba726931731625a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:10.077386 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3b31b107-e387-42af-b58b-43bde9912166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:10.084371 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1432/2896] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:11.185695 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:11.187227 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:11.267199 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3e959-e39e-4ed7-b2f2-2c1a5ba322f9 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:11.273473 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:11.274092 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:11.274408 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:11.274676 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:11.276714 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:11.289261 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:11.290861 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fff69-3783-491f-b3f8-41fa9756e445 service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:11.301418 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1465/2897] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:52:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:52:20.071047 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=14 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:21.296823 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:25.672720 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:25.673239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:25.673239 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:25.691501 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] MFA Rules not processed for user `42672230cde04b5ba726931731625a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:25.692855 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:25.702276 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1433/2898] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:35.686025 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:43.948655 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aaec1-f204-4371-8b89-fe2680fb1a48 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:43.949271 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aaec1-f204-4371-8b89-fe2680fb1a48 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:43.949419 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aaec1-f204-4371-8b89-fe2680fb1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:44.007842 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-882aaec1-f204-4371-8b89-fe2680fb1a48 None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:44.009535 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-882aaec1-f204-4371-8b89-fe2680fb1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:44.092218 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1466/2899] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 22:52:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:44.146890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:44.148459 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:44.242749 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b6d1d-7254-460a-a740-175b3c3460ed None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:44.248165 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:44.248821 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:44.249090 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:44.249359 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:44.258144 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:44.259797 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:44.268737 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1434/2900] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:52:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:52:54.086907 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=40 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:54.264945 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=41 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:58.558647 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:58.559156 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:58.559264 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:58.577800 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] MFA Rules not processed for user `fc8fa6b53b194df0831995429213db40`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:52:58.579021 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:52:58.586379 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1467/2901] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 22:52:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:52:58.602213 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:52:58.615822 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d05a3-9653-462e-a70c-abb1165fdd0c service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:52:58.622232 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd298476d65ba4329b5aea924e7fd5f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:52:58.622870 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:52:58.623182 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:52:58.623453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:52:58.632723 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:52:58.634259 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:52:58.642771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1435/2902] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 22:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:53:00.563631 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:00.576549 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9467e-4066-4d93-8991-2a787c55b35e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:00.581932 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:00.582665 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:00.582946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:00.583239 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:00.585330 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:00.598390 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:00.600067 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:00.613858 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1468/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:53:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:53:00.624023 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:00.635651 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dbf1d-d35b-4911-8c1f-2623b39cbc31 service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:00.641980 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:00.642845 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:00.643175 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:00.643450 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] PATH_INFO: `/v3/users/42672230cde04b5ba726931731625a29` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:00.644672 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42672230cde04b5ba726931731625a29)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:00.646711 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:00.697493 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42672230cde04b5ba726931731625a29'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:00.706715 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42672230cde04b5ba726931731625a29'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:00.707381 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42672230cde04b5ba726931731625a29'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:00.715316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42672230cde04b5ba726931731625a29'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:00.728299 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-25a7d7f3-454e-43d3-a3ea-7538417c9d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42672230cde04b5ba726931731625a29'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:00.735832 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1436/2904] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:53:00 2022] DELETE /identity/v3/users/42672230cde04b5ba726931731625a29 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:53:00.913843 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:00.924933 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb4e4c-92b1-4c38-b646-add3ff9d03cf service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:00.983243 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:00.984135 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:00.984414 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:00.984690 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] PATH_INFO: `/v3/projects/e5ef3c721f764770b9b91a3a0563ad48` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:00.985887 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ef3c721f764770b9b91a3a0563ad48)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:00.988632 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.039594 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ef3c721f764770b9b91a3a0563ad48', 'request_id': 'req-23142979-b64b-43aa-b5d5-637cf5999cd9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:01.051277 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ef3c721f764770b9b91a3a0563ad48', 'request_id': 'req-23142979-b64b-43aa-b5d5-637cf5999cd9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:01.058073 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ef3c721f764770b9b91a3a0563ad48', 'request_id': 'req-23142979-b64b-43aa-b5d5-637cf5999cd9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:01.069541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] The token cache is being invalidate because project e5ef3c721f764770b9b91a3a0563ad48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:53:01.069857 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:01.070524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23142979-b64b-43aa-b5d5-637cf5999cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:01.072125 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1469/2905] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:53:00 2022] DELETE /identity/v3/projects/e5ef3c721f764770b9b91a3a0563ad48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:53:01.077465 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.077753 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.078028 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.098186 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:53:01.099379 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:01.171525 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1437/2906] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:53:01.181610 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.182124 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.182639 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.204541 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:53:01.205782 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:01.216294 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1470/2907] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:53:01.220986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.233031 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450b12d-2fc6-474c-8c2b-6482e706a2fb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.242620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.243345 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.243613 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.243890 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.244632 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:53:01.244986 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.246612 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.259798 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1438/2908] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 22:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:53:01.264465 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.274770 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e0e7c-f07c-4b63-953e-842b22de6b8d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.281524 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.282513 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.282794 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.283100 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.283799 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.285728 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.320747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1471/2909] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 22:53:01 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:53:01.324883 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.336596 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775b25d-568e-49aa-81e8-1fe2fb49ba09 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.386100 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:01.400643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.401328 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.401624 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.401886 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.402584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.404560 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.426799 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1439/2910] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 22:53:01 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:53:01.431288 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.441908 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5446-bd41-47cc-ab02-dfe566306589 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.446882 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.447596 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.447874 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.448157 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.448901 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.450825 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.461962 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1472/2911] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:53:01.468303 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.484502 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178989f-b60c-4a95-a407-0951172979f1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.490363 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af043c1-bae7-428b-bfd1-cc5975159b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.491081 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af043c1-bae7-428b-bfd1-cc5975159b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.491367 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af043c1-bae7-428b-bfd1-cc5975159b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.491623 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af043c1-bae7-428b-bfd1-cc5975159b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.492351 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af043c1-bae7-428b-bfd1-cc5975159b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.493984 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af043c1-bae7-428b-bfd1-cc5975159b3d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.505106 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1440/2912] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 22:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:53:01.509815 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.521036 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a338fc-8e96-45f0-9420-54695b269b57 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.526666 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.527564 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.527844 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.528116 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] PATH_INFO: `/v3/projects/5551177620ed43ec8f535099f81665c5/users/52ac89df1adc43e7b8ca522332f3f5a4/roles/a7d68a2ab9454e02b30ff8582267dd82` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.544413 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5551177620ed43ec8f535099f81665c5, user_id=52ac89df1adc43e7b8ca522332f3f5a4, role_id=a7d68a2ab9454e02b30ff8582267dd82)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.547140 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.561747 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1473/2913] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 22:53:01 2022] PUT /identity/v3/projects/5551177620ed43ec8f535099f81665c5/users/52ac89df1adc43e7b8ca522332f3f5a4/roles/a7d68a2ab9454e02b30ff8582267dd82 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:53:01.576951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.577237 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.577584 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.606942 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] MFA Rules not processed for user `52ac89df1adc43e7b8ca522332f3f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:53:01.608176 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:01.681320 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1441/2914] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:53:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:53:01.692902 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:01.694819 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:01.705226 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:01.754449 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b569-92b1-4cf8-a3a8-bf91f1b25778 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:01.758463 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913afe67-6e19-475d-b760-e367899b7049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0861b19130e41e39a57a61c8972336f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:01.759152 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913afe67-6e19-475d-b760-e367899b7049 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:01.759433 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913afe67-6e19-475d-b760-e367899b7049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:01.759710 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913afe67-6e19-475d-b760-e367899b7049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:01.768730 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913afe67-6e19-475d-b760-e367899b7049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:01.770237 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913afe67-6e19-475d-b760-e367899b7049 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:01.779946 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1474/2915] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:53:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:53:06.840316 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:06.905048 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e9c79-8460-4d02-9b3b-303c0b1c5fe8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:06.911620 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:06.912494 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:06.912767 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:06.913038 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] PATH_INFO: `/v3/users/52ac89df1adc43e7b8ca522332f3f5a4` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:06.914339 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ac89df1adc43e7b8ca522332f3f5a4)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:06.916315 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:06.966428 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ac89df1adc43e7b8ca522332f3f5a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:06.974643 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ac89df1adc43e7b8ca522332f3f5a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:06.975378 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ac89df1adc43e7b8ca522332f3f5a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:06.977453 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:06.984251 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ac89df1adc43e7b8ca522332f3f5a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:06.996479 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ac89df1adc43e7b8ca522332f3f5a4'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:07.002391 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1442/2916] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 22:53:06 2022] DELETE /identity/v3/users/52ac89df1adc43e7b8ca522332f3f5a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:53:07.007121 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:07.007637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:07.007637 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:07.025944 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] MFA Rules not processed for user `bd30b180b5054c1bbf1a42f4fe12ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:53:07.027179 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:07.097509 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1475/2917] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 22:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:53:07.110585 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:07.112863 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:07.179340 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3812-2547-40dd-99d6-8b25a960e683 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:07.185951 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255eebd418f42b28a810c7d9e86162f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:07.186929 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:07.187338 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:07.187743 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:07.199565 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:07.201869 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:07.214752 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1443/2918] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:53:07.769095 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:53:07.770872 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:53:07.783992 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a736c-7b83-4850-bc1c-8e3a5bcb1c0b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:53:07.789335 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd30b180b5054c1bbf1a42f4fe12ac4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68110cc172da4f7f98143d7196095a84', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:53:07.790478 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:53:07.790827 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:53:07.791205 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] PATH_INFO: `/v3/projects/5551177620ed43ec8f535099f81665c5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:53:07.792506 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5551177620ed43ec8f535099f81665c5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:53:07.794866 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:53:07.845359 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5551177620ed43ec8f535099f81665c5', 'request_id': 'req-e1a95781-d1e3-4acd-922e-60d9bde40018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:07.856399 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5551177620ed43ec8f535099f81665c5', 'request_id': 'req-e1a95781-d1e3-4acd-922e-60d9bde40018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:07.862920 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5551177620ed43ec8f535099f81665c5', 'request_id': 'req-e1a95781-d1e3-4acd-922e-60d9bde40018'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:07.874638 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] The token cache is being invalidate because project 5551177620ed43ec8f535099f81665c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:53:07.874948 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:07.875670 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-e1a95781-d1e3-4acd-922e-60d9bde40018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:53:07.877284 dv-cinder-850696-1-smb devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1476/2919] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 22:53:07 2022] DELETE /identity/v3/projects/5551177620ed43ec8f535099f81665c5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:53:17.209750 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=36,keystone:DELETE=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:17.871812 dv-cinder-850696-1-smb devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:23.219254 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:57:23.220771 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:57:23.394790 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903269-775a-4d03-aa1a-3264dae7b625 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:57:23.468830 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac86cfdd00a43678c8506217f83ecdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ff00ec694948f38903c2fa3edca2af', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:57:23.469757 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:57:23.469909 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:57:23.470283 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:57:23.472225 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:57:23.486341 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:57:23.488342 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947f1b0-26ed-478d-8eea-ea886f7cb9b7 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:57:23.499686 dv-cinder-850696-1-smb devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1444/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 22:57:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:57:33.495495 dv-cinder-850696-1-smb devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=89 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}